sdb.admin.uw.edu
robots.txt

Robots Exclusion Standard data for sdb.admin.uw.edu

Resource Scan

Scan Details

Site Domain sdb.admin.uw.edu
Base Domain uw.edu
Scan Status Ok
Last Scan2025-12-21T21:39:50+00:00
Next Scan 2026-01-20T21:39:50+00:00

Last Scan

Scanned2025-12-21T21:39:50+00:00
URL https://sdb.admin.uw.edu/robots.txt
Domain IPs 140.142.18.16
Response IP 140.142.18.16
Found Yes
Hash d96a05a1f6f070c7ea80c8106b223e03645bce663545a6586693bb82c7b693f9
SimHash b81fcbebcff7

Groups

*

Rule Path
Disallow /

stress-agent

Rule Path
Disallow /

Comments

  • Restrict all web spiders
  • http://info.webcrawler.com/mak/projects/robots/norobots.html
  • MS Web App Stress Tool looks only for entry below