artsci.org
robots.txt

Robots Exclusion Standard data for artsci.org

Resource Scan

Scan Details

Site Domain artsci.org
Base Domain artsci.org
Scan Status Ok
Last Scan2025-10-08T21:20:52+00:00
Next Scan 2025-11-07T21:20:52+00:00

Last Scan

Scanned2025-10-08T21:20:52+00:00
URL http://artsci.org/robots.txt
Domain IPs 50.63.8.46
Response IP 50.63.8.46
Found Yes
Hash f28215d3d65a718a7a261fe2f0951dce9cc9f2e721a293b8e46c2eea133e6282
SimHash 6d395064c3d3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5