cautionspoilers.com
robots.txt

Robots Exclusion Standard data for cautionspoilers.com

Resource Scan

Scan Details

Site Domain cautionspoilers.com
Base Domain cautionspoilers.com
Scan Status Ok
Last Scan2025-10-12T02:57:12+00:00
Next Scan 2025-10-19T02:57:12+00:00

Last Scan

Scanned2025-10-12T02:57:12+00:00
URL https://cautionspoilers.com/robots.txt
Redirect https://www.cautionspoilers.com/robots.txt
Redirect Domain www.cautionspoilers.com
Redirect Base cautionspoilers.com
Domain IPs 104.21.58.21, 172.67.197.126, 2606:4700:3033::6815:3a15, 2606:4700:3034::ac43:c57e
Redirect IPs 104.21.58.21, 172.67.197.126, 2606:4700:3033::6815:3a15, 2606:4700:3034::ac43:c57e
Response IP 172.67.197.126
Found Yes
Hash 7e0382298ca134be74f0304e21b01e72cdba4f8b99082c8328eccb1e28fd624a
SimHash 6411dc304396

Groups

*

Rule Path
Disallow /uncategorised/*

Other Records

Field Value
crawl-delay 2