epicenter.stanford.edu
robots.txt

Robots Exclusion Standard data for epicenter.stanford.edu

Resource Scan

Scan Details

Site Domain epicenter.stanford.edu
Base Domain stanford.edu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-06-25T23:08:33+00:00
Next Scan 2025-08-24T23:08:33+00:00

Last Successful Scan

Scanned2022-10-06T05:30:37+00:00
URL http://epicenter.stanford.edu/robots.txt
Response IP 52.92.160.43
Found Yes
Hash e5c8a7d1081861d9de350e8e5bf7ee121e70dcbdf3d5c7924898cda0592c02ba
SimHash 69081dd34672

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap http://epicenter.stanford.edu/sitemap.xml

Comments

  • /robots.txt file for http://epicenter.stanford.edu/