uwex.uwc.edu
robots.txt

Robots Exclusion Standard data for uwex.uwc.edu

Resource Scan

Scan Details

Site Domain uwex.uwc.edu
Base Domain uwc.edu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-10-27T19:36:59+00:00
Next Scan 2026-01-25T19:36:59+00:00

Last Successful Scan

Scanned2022-06-22T04:54:07+00:00
URL http://uwex.uwc.edu/robots.txt
Response IP 23.185.0.1
Found Yes
Hash 885ece1835d3d7106496ced8aab5b58cd83465ed3d8b7ee8a5dab687d79622e8
SimHash 8808db22a6a2

Groups

*

Rule Path
Disallow /

ravencrawler
rogerbot
dotbot
semrushbot
semrushbot-sa
powermapper
swiftbot

Rule Path
Allow /

Comments

  • Pantheon's documentation on robots.txt: https://pantheon.io/docs/bots-and-indexing/