physics.bu.edu
robots.txt

Robots Exclusion Standard data for physics.bu.edu

Resource Scan

Scan Details

Site Domain physics.bu.edu
Base Domain bu.edu
Scan Status Ok
Last Scan2025-07-01T22:34:33+00:00
Next Scan 2025-07-31T22:34:33+00:00

Last Scan

Scanned2025-07-01T22:34:33+00:00
URL https://physics.bu.edu/robots.txt
Domain IPs 128.197.41.42
Response IP 128.197.41.42
Found Yes
Hash 03f37f94ea0619eb9f94429dbbc0193007a9371b00a494b6e8a8870c4aba5f74
SimHash a85c2b8de762

Groups

*

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file