pets.24tv.ua
robots.txt
Robots Exclusion Standard data for pets.24tv.ua
Resource Scan
Scan Details
| Site Domain | pets.24tv.ua |
| Base Domain | 24tv.ua |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-14T12:52:37+00:00 |
| Next Scan | 2024-11-21T12:52:37+00:00 |
Last Successful Scan
| Scanned | 2024-01-03T01:27:47+00:00 |
| URL | https://pets.24tv.ua/robots.txt |
| Domain IPs | 104.22.50.244, 104.22.51.244, 172.67.22.142, 2606:4700:10::6816:32f4, 2606:4700:10::6816:33f4, 2606:4700:10::ac43:168e |
| Response IP | 104.22.50.244 |
| Found | Yes |
| Hash | 221432bdc0e3e6e6f3f04c60223ad2ecf72df7110e055036887df98d3540dee5 |
| SimHash | 0d04b3225811 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cdn-cgi/ |
| Disallow | /*?f=false |
| Disallow | /football/ |
| Disallow | /home/showArchive.do |
| Disallow | /home/showInformer%21show.do |
| Disallow | /home/login%21loginOpenId.do |
| Disallow | /home/changeLanguage.do |
| Disallow | /tags/showMyNews.do |
| Disallow | /users/ |
| Disallow | /home/home/ |
| Disallow | /search/search.do |
| Disallow | /plugins/feedback.php |
| Disallow | /56301415/ |
| Disallow | /113579682/ |
| Disallow | /news/updateReviewsCount.ajx |
| Disallow | /fb-messenger%3A//share/* |
| Disallow | /viber%3A//forward* |
| Disallow | /*amp?siteId* |
| Allow | / |
| Disallow | /new-main-page |
| Disallow | /mobile/news/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pets.24tv.ua/sitemapindex.xml |