registrar.indiana.edu
robots.txt

Robots Exclusion Standard data for registrar.indiana.edu

Resource Scan

Scan Details

Site Domain registrar.indiana.edu
Base Domain indiana.edu
Scan Status Ok
Last Scan2024-09-27T18:52:11+00:00
Next Scan 2024-10-27T18:52:11+00:00

Last Scan

Scanned2024-09-27T18:52:11+00:00
URL https://registrar.indiana.edu/robots.txt
Domain IPs 129.79.123.142, 129.79.123.143, 2001:18e8:2:e::11d, 2001:18e8:2:e::11e
Response IP 129.79.123.143
Found Yes
Hash 5ad861b421161393a450d3b272ec41ec8ad878a1183895c0ab764eaf4d7643ca
SimHash 6f01abd0fb9e

Groups

adsbot-google-mobile

Rule Path
Allow /campaigns/

adsbot-google

Rule Path
Allow /campaigns/

*

Rule Path
Disallow /chunks/
Disallow /_assets/
Disallow /_documentation/
Disallow /_examples/
Disallow /_feeds/
Disallow /_home/
Disallow /_includes/
Disallow /_internal/
Disallow /_php/
Disallow /_shared-sections/
Disallow /gwassets/
Disallow /error/
Disallow /machform/
Disallow /search/index.html
Disallow /search/index.htm
Disallow /search/index.shtml

Other Records

Field Value
sitemap https://registrar.indiana.edu/sitemap.xml