connects.catalyst.harvard.edu
robots.txt

Robots Exclusion Standard data for connects.catalyst.harvard.edu

Resource Scan

Scan Details

Site Domain connects.catalyst.harvard.edu
Base Domain harvard.edu
Scan Status Ok
Last Scan2025-07-02T05:06:18+00:00
Next Scan 2025-08-01T05:06:18+00:00

Last Scan

Scanned2025-07-02T05:06:18+00:00
URL https://connects.catalyst.harvard.edu/robots.txt
Domain IPs 134.174.153.36
Response IP 134.174.153.36
Found Yes
Hash cea31ec2ea1cb3c5a8499107b91be8f89171a8369b25fc45ecee9f3339d56304
SimHash 5105325489db

Groups

*

Rule Path
Disallow /Atlas/
Disallow /Profiles/search/
Disallow /Profiles/Framework/
Disallow /Profiles/Dashboard/
Disallow /Profiles/Edit/
Disallow /Profiles/GroupAdmin/
Disallow /Profiles/Lists/
Disallow /Profiles/Proxy/
Disallow /Profiles/StudentOpportunities/

Other Records

Field Value
sitemap http://connects.catalyst.harvard.edu/profiles/sitemap.ashx