newsday.sportsdirectinc.com
robots.txt

Robots Exclusion Standard data for newsday.sportsdirectinc.com

Resource Scan

Scan Details

Site Domain newsday.sportsdirectinc.com
Base Domain sportsdirectinc.com
Scan Status Ok
Last Scan2024-11-11T20:47:49+00:00
Next Scan 2024-11-25T20:47:49+00:00

Last Scan

Scanned2024-11-11T20:47:49+00:00
URL http://newsday.sportsdirectinc.com/robots.txt
Domain IPs 13.227.254.10, 13.227.254.102, 13.227.254.115, 13.227.254.45
Response IP 13.227.254.45
Found Yes
Hash 67df7d2ff09ded8ec6c1d99ede8b51d7f6d8922c4975b4929c8ebbcf6b8aaad5
SimHash 6510d452e735

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1