hai.stanford.edu
robots.txt

Robots Exclusion Standard data for hai.stanford.edu

Resource Scan

Scan Details

Site Domain hai.stanford.edu
Base Domain stanford.edu
Scan Status Ok
Last Scan2025-03-03T17:31:05+00:00
Next Scan 2025-04-02T17:31:05+00:00

Last Scan

Scanned2025-03-03T17:31:05+00:00
URL https://hai.stanford.edu/robots.txt
Domain IPs 2600:9000:2894:1400:10:80f1:5d40:93a1, 2600:9000:2894:3e00:10:80f1:5d40:93a1, 2600:9000:2894:4a00:10:80f1:5d40:93a1, 2600:9000:2894:5200:10:80f1:5d40:93a1, 2600:9000:2894:9e00:10:80f1:5d40:93a1, 2600:9000:2894:a600:10:80f1:5d40:93a1, 2600:9000:2894:aa00:10:80f1:5d40:93a1, 2600:9000:2894:e400:10:80f1:5d40:93a1, 3.170.229.24, 3.170.229.33, 3.170.229.50, 3.170.229.83
Response IP 3.170.229.50
Found Yes
Hash 297fd5ac58cf895b3c9cd62f16dc942d10d3216f136b19d1cfa645e7e60ad43d
SimHash 4914d9504733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://staging.hai.typeco.de/sitemap.xml