city42.tv
robots.txt
Robots Exclusion Standard data for city42.tv
Resource Scan
Scan Details
| Site Domain | city42.tv |
| Base Domain | city42.tv |
| Scan Status | Ok |
| Last Scan | 2024-09-23T15:27:57+00:00 |
| Next Scan | 2024-09-30T15:27:57+00:00 |
Last Scan
| Scanned | 2024-09-23T15:27:57+00:00 |
| URL | https://city42.tv/robots.txt |
| Redirect | https://www.city42.tv/robots.txt |
| Redirect Domain | www.city42.tv |
| Redirect Base | city42.tv |
| Domain IPs | 65.21.69.178 |
| Redirect IPs | 65.21.69.178 |
| Response IP | 65.21.69.178 |
| Found | Yes |
| Hash | 61ec047d7e957636031a9865bde63e03f9377eff4608b3be9afe2ffe537b7dd5 |
| SimHash | e94dc9939c90 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /test-ad-code/ |
| Disallow | /xajax/ |
| Disallow | /ajax_post_update |
| Disallow | /ajax_post_pagination |
| Disallow | /ajax_author_type_pagination |
| Disallow | /ajax_block_pagination |
| Disallow | /ajax_poll_pagination |
| Disallow | /poll_entry_submission |
| Disallow | /parse_oembed_links |
| Disallow | /oembed |
| Disallow | /oembed_videos |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.city42.tv/sitemap_news.xml |
| sitemap | https://www.city42.tv/sitemap_news_google.xml |
| sitemap | https://www.city42.tv/sitemap.xml |