www.owp.csus.edu
robots.txt

Robots Exclusion Standard data for www.owp.csus.edu

Resource Scan

Scan Details

Site Domain www.owp.csus.edu
Base Domain csus.edu
Scan Status Ok
Last Scan2025-12-08T14:27:19+00:00
Next Scan 2026-01-07T14:27:19+00:00

Last Scan

Scanned2025-12-08T14:27:19+00:00
URL https://www.owp.csus.edu/robots.txt
Domain IPs 130.86.9.22
Response IP 130.86.9.22
Found Yes
Hash 78d8aa7241b06617de53731934e1c7f52de584e6bb881756d2dd107ddd089b60
SimHash 2d54da006555

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

Comments

  • Block all crawlers by default
  • Allow Google
  • Allow Bing
  • Allow Yahoo
  • Allow DuckDuckGo