hofstra.edu
robots.txt
Robots Exclusion Standard data for hofstra.edu
Resource Scan
Scan Details
Site Domain | hofstra.edu |
Base Domain | hofstra.edu |
Scan Status | Ok |
Last Scan | 2024-09-07T00:04:51+00:00 |
Next Scan | 2024-10-07T00:04:51+00:00 |
Last Scan
Scanned | 2024-09-07T00:04:51+00:00 |
URL | https://hofstra.edu/robots.txt |
Redirect | https://www.hofstra.edu/robots.txt |
Redirect Domain | www.hofstra.edu |
Redirect Base | hofstra.edu |
Domain IPs | 107.20.231.141 |
Redirect IPs | 13.33.28.113, 13.33.28.49, 13.33.28.56, 13.33.28.70 |
Response IP | 13.33.28.56 |
Found | Yes |
Hash | 90eca0ef61bd2e05e208e291c6b65054b7a117bc263076023b783fdc2cb6f838 |
SimHash | 80115dc6e991 |
Groups
*
Rule | Path |
---|---|
Disallow | /mobile/edtech/* |
Disallow | /graduate/open-house-test.html |
Disallow | /graduate/open-house.html |
Comments