events.anr.msu.edu
robots.txt

Robots Exclusion Standard data for events.anr.msu.edu

Resource Scan

Scan Details

Site Domain events.anr.msu.edu
Base Domain msu.edu
Scan Status Ok
Last Scan2025-09-16T13:21:10+00:00
Next Scan 2025-10-16T13:21:10+00:00

Last Scan

Scanned2025-09-16T13:21:10+00:00
URL https://events.anr.msu.edu/robots.txt
Domain IPs 45.223.140.216
Response IP 45.223.140.216
Found Yes
Hash c4126f6e1d3c69c5aba158eb4a370a3f440cd53cea59db517ed865a9ba22032b
SimHash b91c3ca222f2

Groups

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /components/
Disallow /css/
Disallow /images/
Disallow /includes/
Disallow /themes/

Other Records

Field Value
crawl-delay 60

Comments

  • /robots.txt file for https://events.anr.msu.edu