physics.purdue.edu
robots.txt
Robots Exclusion Standard data for physics.purdue.edu
Resource Scan
Scan Details
Site Domain | physics.purdue.edu |
Base Domain | purdue.edu |
Scan Status | Ok |
Last Scan | 2025-06-14T00:30:26+00:00 |
Next Scan | 2025-07-14T00:30:26+00:00 |
Last Scan
Scanned | 2025-06-14T00:30:26+00:00 |
URL | http://physics.purdue.edu/robots.txt |
Redirect | https://www.physics.purdue.edu/robots.txt |
Redirect Domain | www.physics.purdue.edu |
Redirect Base | purdue.edu |
Domain IPs | 128.210.69.21 |
Redirect IPs | 128.210.69.21 |
Response IP | 128.210.69.21 |
Found | Yes |
Hash | a682a1691abf570df0aff82c74bfea711a5e2288fe744cebe5f4de0b2d62a8af |
SimHash | 8848dc2586c3 |
Groups
*
Rule | Path |
---|---|
Disallow | /bugzilla/ |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
*
Rule | Path |
---|---|
Disallow | /kiosk/ |
*
Rule | Path |
---|---|
Disallow | /webapps/ |
*
Rule | Path |
---|---|
Disallow | /Zope/business_office/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.physics.purdue.edu/sitemap.xml |