catch90.com
robots.txt

Robots Exclusion Standard data for catch90.com

Resource Scan

Scan Details

Site Domain catch90.com
Base Domain catch90.com
Scan Status Ok
Last Scan2025-10-20T22:17:56+00:00
Next Scan 2025-10-27T22:17:56+00:00

Last Scan

Scanned2025-10-20T22:17:56+00:00
URL https://catch90.com/robots.txt
Redirect https://www.catch90.com/robots.txt
Redirect Domain www.catch90.com
Redirect Base catch90.com
Domain IPs 199.34.228.159
Redirect IPs 199.34.228.159
Response IP 199.34.228.159
Found Yes
Hash 76fc7be11d6037233c76b8b48a4bdb5b2a7f9a76e40edda6674d81337e6a613c
SimHash a055d4706f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path Comment
Disallow /ajax/ -
Disallow /apps/ -
Disallow /https%3A//www.catch90.com/home/category/movie /
Disallow /https%3A//www.catch90.com/home/category/drinks /
Disallow /https%3A//www.catch90.com/home/category/recipe /
Disallow /https%3A//www.catch90.com/home/category/video /
Disallow /https%3A//www.catch90.com/home/category/weekend /
Disallow /https%3A//www.catch90.com/home/category/books /

Other Records

Field Value
sitemap https://www.catch90.com/sitemap.xml