santafe.edu
robots.txt
Robots Exclusion Standard data for santafe.edu
Resource Scan
Scan Details
| Site Domain | santafe.edu |
| Base Domain | santafe.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-31T16:49:58+00:00 |
| Next Scan | 2024-06-30T16:49:58+00:00 |
Last Scan
| Scanned | 2024-05-31T16:49:58+00:00 |
| URL | https://santafe.edu/robots.txt |
| Redirect | https://s3.amazonaws.com/sfi-edu/sfi-edu/production/static/seo/Robots.txt |
| Redirect Domain | s3.amazonaws.com |
| Redirect Base | s3.amazonaws.com |
| Domain IPs | 192.12.12.13 |
| Redirect IPs | 16.182.101.96, 16.182.105.240, 16.182.68.112, 3.5.8.25, 52.216.205.245, 52.216.59.208, 52.217.174.192, 54.231.131.48 |
| Response IP | 52.217.233.80 |
| Found | Yes |
| Hash | 5533dc56cf155fe74f00c2588180dbdbe63483ba70e2056b8e08fa241c46450e |
| SimHash | 0894dc21cf1a |
Groups
amazonbot
| Product | Comment |
|---|---|
| amazonbot | Amazon's user agent |
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | disallow everything |
ahrefsbot
| Product | Comment |
|---|---|
| ahrefsbot | AhrefsBot's user agent |
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | disallow everything |
*
| Rule | Path |
|---|---|
| Disallow | /web-prod.santafe.edu/* |
| Disallow | /samoa.santafe.edu/* |
| Disallow | /santafe.edu/visitor-info |
| Disallow | /www.santafe.edu/visitor-info |
| Disallow | /santafe.edu/pages/action-calendar-events-2020 |
| Disallow | /santafe.edu/pages/action-calendar-events-2020 |
| Disallow | /pages/action-calendar-events-2020 |
| Disallow | /info/investigating-reality/* |
| Disallow | *.gif |
| Disallow | |
| Disallow | */videos/play |
| Disallow | /tuvalu.santafe.edu/* |
| Disallow | *.jpg |
| Disallow | *.ps |
| Disallow | /genwaku.santafe.edu/* |
| Disallow | /pcdb.santafe.edu/* |
| Disallow | /c4.santafe.edu/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://s3.amazonaws.com/sfi-edu/sfi-edu/production/static/seo/sitemap.xml |