fau.edu
robots.txt
Robots Exclusion Standard data for fau.edu
Resource Scan
Scan Details
Site Domain | fau.edu |
Base Domain | fau.edu |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-11-14T08:29:12+00:00 |
Next Scan | 2024-11-21T08:29:12+00:00 |
Last Successful Scan
Scanned | 2024-10-14T08:28:22+00:00 |
URL | https://fau.edu/robots.txt |
Redirect | https://www.fau.edu/robots.txt |
Redirect Domain | www.fau.edu |
Redirect Base | fau.edu |
Domain IPs | 131.91.101.181 |
Redirect IPs | 131.91.101.181 |
Response IP | 131.91.101.181 |
Found | Yes |
Hash | bec675505be9acd3731635e6e21c938c0c8f170e5c97e4326be89b78496fb93b |
SimHash | 89108ad72f93 |
Groups
*
Rule | Path |
---|---|
Disallow | /president/search/candidate_files |
Disallow | /president/provostsearch/ |
Disallow | /admissions/mobile/ |
Disallow | /mobile/admissions/ |
Disallow | /mobile/tickets/ |
Disallow | /planning/ |
Disallow | /strategicplan/ |
Disallow | /strategicplan/hidden/ |
Disallow | /QEP_old/ |
Disallow | /research_old/ |
Disallow | /irm-old/ |
Disallow | /regulations/archives/ |
Disallow | /policies/archives/ |
Disallow | /divdept/caupa_copy/ |
Disallow | /zz-ldp/ |
Disallow | /ss-lp-index.php |
Disallow | /staging-biology/ |
Disallow | /transfer/campaign/ |
Disallow | /future/ |
Disallow | /medicine/newsletter/ |
Disallow | /medicine/community/draft/ |
Disallow | /medicine/community/pathways/famu/ |
Allow | / |