news.osu.edu
robots.txt

Robots Exclusion Standard data for news.osu.edu

Resource Scan

Scan Details

Site Domain news.osu.edu
Base Domain osu.edu
Scan Status Ok
Last Scan2025-08-23T11:35:14+00:00
Next Scan 2025-09-22T11:35:14+00:00

Last Scan

Scanned2025-08-23T11:35:14+00:00
URL https://news.osu.edu/robots.txt
Domain IPs 2a05:d014:dd2:c300:412d:c689:7c50:6226, 2a05:d014:dd2:c301:7fa2:110c:672c:97c, 2a05:d014:dd2:c302:73c1:2614:25d6:985a, 3.67.147.171, 52.58.159.35, 52.58.86.198
Response IP 52.58.86.198
Found Yes
Hash 31c6c6d3809652dfc81e8946e6d99288f1d58ab8f4e0eb4cfacad3dd01b04190
SimHash 61189854c733

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://news.osu.edu/sitemap.xml