whatsthescore.com
robots.txt

Robots Exclusion Standard data for whatsthescore.com

Resource Scan

Scan Details

Site Domain whatsthescore.com
Base Domain whatsthescore.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-30T19:39:13+00:00
Next Scan 2025-12-29T19:39:13+00:00

Last Successful Scan

Scanned2025-02-10T12:25:44+00:00
URL https://whatsthescore.com/robots.txt
Redirect https://www.whatsthescore.com/robots.txt
Redirect Domain www.whatsthescore.com
Redirect Base whatsthescore.com
Domain IPs 104.21.20.92, 172.67.192.9, 2606:4700:3033::ac43:c009, 2606:4700:3035::6815:145c
Redirect IPs 104.21.20.92, 172.67.192.9, 2606:4700:3033::ac43:c009, 2606:4700:3035::6815:145c
Response IP 172.67.192.9
Found Yes
Hash 97684e3d1dc607ccc62ebecba371ee2492ae3d6b8dc4c58fa0bfa70f94f93f1d
SimHash eb06d882e3a0

Groups

petalbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

dataforseobot

Rule Path
Disallow /

*

Rule Path
Disallow /api/user/set/timezone
Disallow /app_dev.php