uits.iu.edu
robots.txt

Robots Exclusion Standard data for uits.iu.edu

Resource Scan

Scan Details

Site Domain uits.iu.edu
Base Domain iu.edu
Scan Status Ok
Last Scan2024-09-17T02:52:45+00:00
Next Scan 2024-10-17T02:52:45+00:00

Last Scan

Scanned2024-09-17T02:52:45+00:00
URL https://uits.iu.edu/robots.txt
Domain IPs 129.79.123.142, 129.79.123.143, 2001:18e8:2:e::11d, 2001:18e8:2:e::11e
Response IP 129.79.123.142
Found Yes
Hash 4ce47df2be88fab3c2b88802195bd0b8b46046debab9e25b72ec2027f27e5823
SimHash 4f01a9d0fb9e

Groups

adsbot-google-mobile

Rule Path
Allow /campaigns/

adsbot-google

Rule Path
Allow /campaigns/

*

Rule Path
Disallow /chunks/
Disallow /_assets/
Disallow /_documentation/
Disallow /_examples/
Disallow /_feeds/
Disallow /_home/
Disallow /_includes/
Disallow /_internal/
Disallow /_php/
Disallow /_shared-sections/
Disallow /gwassets/
Disallow /error/
Disallow /machform/
Disallow /search/index.html
Disallow /search/index.htm
Disallow /search/index.shtml

Other Records

Field Value
sitemap https://uits.iu.edu/sitemap.xml