fau.edu
robots.txt

Robots Exclusion Standard data for fau.edu

Resource Scan

Scan Details

Site Domain fau.edu
Base Domain fau.edu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-06T08:27:37+00:00
Next Scan 2024-10-07T08:27:37+00:00

Last Successful Scan

Scanned2024-09-06T08:27:27+00:00
URL https://fau.edu/robots.txt
Redirect https://www.fau.edu/robots.txt
Redirect Domain www.fau.edu
Redirect Base fau.edu
Domain IPs 131.91.101.181
Redirect IPs 131.91.101.181
Response IP 131.91.101.181
Found Yes
Hash bec675505be9acd3731635e6e21c938c0c8f170e5c97e4326be89b78496fb93b
SimHash 89108ad72f93

Groups

*

Rule Path
Disallow /president/search/candidate_files
Disallow /president/provostsearch/
Disallow /admissions/mobile/
Disallow /mobile/admissions/
Disallow /mobile/tickets/
Disallow /planning/
Disallow /strategicplan/
Disallow /strategicplan/hidden/
Disallow /QEP_old/
Disallow /research_old/
Disallow /irm-old/
Disallow /regulations/archives/
Disallow /policies/archives/
Disallow /divdept/caupa_copy/
Disallow /zz-ldp/
Disallow /ss-lp-index.php
Disallow /staging-biology/
Disallow /transfer/campaign/
Disallow /future/
Disallow /medicine/newsletter/
Disallow /medicine/community/draft/
Disallow /medicine/community/pathways/famu/
Allow /