hofstra.edu
robots.txt

Robots Exclusion Standard data for hofstra.edu

Resource Scan

Scan Details

Site Domain hofstra.edu
Base Domain hofstra.edu
Scan Status Ok
Last Scan2024-09-07T00:04:51+00:00
Next Scan 2024-10-07T00:04:51+00:00

Last Scan

Scanned2024-09-07T00:04:51+00:00
URL https://hofstra.edu/robots.txt
Redirect https://www.hofstra.edu/robots.txt
Redirect Domain www.hofstra.edu
Redirect Base hofstra.edu
Domain IPs 107.20.231.141
Redirect IPs 13.33.28.113, 13.33.28.49, 13.33.28.56, 13.33.28.70
Response IP 13.33.28.56
Found Yes
Hash 90eca0ef61bd2e05e208e291c6b65054b7a117bc263076023b783fdc2cb6f838
SimHash 80115dc6e991

Groups

*

Rule Path
Disallow /mobile/edtech/*
Disallow /graduate/open-house-test.html
Disallow /graduate/open-house.html

Comments

  • robots.txt 2019-07-16