uci.edu
robots.txt

Robots Exclusion Standard data for uci.edu

Resource Scan

Scan Details

Site Domain uci.edu
Base Domain uci.edu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-23T09:47:32+00:00
Next Scan 2024-11-22T09:47:32+00:00

Last Successful Scan

Scanned2024-09-01T09:46:26+00:00
URL https://uci.edu/robots.txt
Domain IPs 44.237.37.40, 52.33.114.235
Response IP 52.33.114.235
Found Yes
Hash d0aaf148b6baecfc75ff67763372b5941419a76526e98dbc71e62a78d6f7c356
SimHash 70151000c193

Groups

*

Rule Path
Disallow /iseb/

Other Records

Field Value
sitemap https://uci.edu/sitemap.php

Comments

  • www.robotstxt.org/
  • http://code.google.com/web/controlcrawlindex/