catchnews.com
robots.txt
Robots Exclusion Standard data for catchnews.com
Resource Scan
Scan Details
| Site Domain | catchnews.com |
| Base Domain | catchnews.com |
| Scan Status | Ok |
| Last Scan | 2024-06-04T17:37:44+00:00 |
| Next Scan | 2024-06-11T17:37:44+00:00 |
Last Scan
| Scanned | 2024-06-04T17:37:44+00:00 |
| URL | https://www.catchnews.com/robots.txt |
| Domain IPs | 104.21.94.49, 172.67.219.164, 2606:4700:3032::6815:5e31, 2606:4700:3032::ac43:dba4 |
| Response IP | 104.21.94.49 |
| Found | Yes |
| Hash | fc35eb53594e7073953b001f69f4fba806255b2c63c54daa3e4efde132a3786b |
| SimHash | 92121d16d3c9 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /index-new.php |
| Disallow | /career/* |
| Disallow | /infographics-page.php* |
| Disallow | /infographics/* |
| Disallow | /articletest.php* |
| Disallow | /listicles.php* |
| Disallow | /listicle.php* |
| Disallow | /deck-inner.php* |
| Disallow | /deck.php* |
| Disallow | /interview.php* |
| Disallow | /live-blog.php* |
| Disallow | /live-page.php* |
| Disallow | /prime-numbers.php* |
| Disallow | /vamp-audio-landing.php* |
| Disallow | /vamp-landing.php* |
| Disallow | /vamp-media-landing.php* |
| Disallow | /vamp-photo-landing.php* |
| Disallow | /vamp-video-landing.php* |
| Disallow | /video-landing.php* |
| Disallow | /wire.php* |
| Disallow | /xpack.php* |
| Disallow | /skim.php* |
| Disallow | /xpack-inner.php* |
| Disallow | /multimedia.php* |
| Disallow | /audio.php* |
| Disallow | /prime_number.php* |
| Disallow | /skim.php* |
| Disallow | /photo-lp.php* |
| Disallow | /audio-lp.php* |
| Disallow | /video-lp.php* |
| Disallow | /multimedia-lp.php* |
| Disallow | /photo/* |
| Disallow | /multimedia/* |
| Disallow | /prime-number/* |
| Disallow | /deck/* |
| Disallow | /video/* |
| Disallow | /audio/* |
| Disallow | /storytest/* |
| Disallow | /testing_story/* |
| Disallow | /xpacks/* |
| Disallow | /hamp/* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.catchnews.com/sitemap.xml |
| sitemap | http://www.catchnews.com/news-sitemap.xml |