thespectatoronline.com
robots.txt

Robots Exclusion Standard data for thespectatoronline.com

Resource Scan

Scan Details

Site Domain thespectatoronline.com
Base Domain thespectatoronline.com
Scan Status Ok
Last Scan2025-09-10T14:31:19+00:00
Next Scan 2025-09-17T14:31:19+00:00

Last Scan

Scanned2025-09-10T14:31:19+00:00
URL https://www.thespectatoronline.com/robots.txt
Domain IPs 104.21.2.2, 172.67.128.113, 2606:4700:3030::ac43:8071, 2606:4700:3033::6815:202
Response IP 172.67.128.113
Found Yes
Hash 4c3fc46e86d0b5e488ba7ddcdf313418d8fcfa56643163708b60d3e89fc76ff1
SimHash 685081956735

Groups

googlebot
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Allow /