www.uwex.uwc.edu
robots.txt

Robots Exclusion Standard data for www.uwex.uwc.edu

Resource Scan

Scan Details

Site Domain www.uwex.uwc.edu
Base Domain uwc.edu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-10-27T06:03:41+00:00
Next Scan 2026-01-25T06:03:41+00:00

Last Successful Scan

Scanned2022-06-27T04:56:22+00:00
URL http://www.uwex.uwc.edu/robots.txt
Response IP 23.185.0.1
Found Yes
Hash 885ece1835d3d7106496ced8aab5b58cd83465ed3d8b7ee8a5dab687d79622e8
SimHash 8808db22a6a2

Groups

*

Rule Path
Disallow /

ravencrawler
rogerbot
dotbot
semrushbot
semrushbot-sa
powermapper
swiftbot

Rule Path
Allow /

Comments

  • Pantheon's documentation on robots.txt: https://pantheon.io/docs/bots-and-indexing/