csiberkeley.com
robots.txt

Robots Exclusion Standard data for csiberkeley.com

Resource Scan

Scan Details

Site Domain csiberkeley.com
Base Domain csiberkeley.com
Scan Status Ok
Last Scan2024-11-01T01:14:13+00:00
Next Scan 2024-12-01T01:14:13+00:00

Last Scan

Scanned2024-11-01T01:14:13+00:00
URL http://csiberkeley.com/robots.txt
Redirect https://www.csiamerica.com/robots.txt
Redirect Domain www.csiamerica.com
Redirect Base csiamerica.com
Domain IPs 40.83.215.15
Redirect IPs 23.32.29.89, 23.32.29.90
Response IP 23.52.40.99
Found Yes
Hash 354bd872e617e6d1c2a71f472d6071d387d78c06a0d68b9a47846fffab093ba6
SimHash 65144f404595

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.csiamerica.com/sitemap.xml

Comments

  • Allow all robots from crawling - CSI America
  • Disallow: