Log In Sign Up

exams.wisc.edu
robots.txt

Robots Exclusion Standard data for exams.wisc.edu

Resource Scan

Scan Details

Site Domain exams.wisc.edu
Base Domain wisc.edu
Scan Status Ok
Last Scan2025-06-17T00:17:05+00:00
Next Scan 2025-07-17T00:17:05+00:00

Last Scan

Scanned2025-06-17T00:17:05+00:00
URL https://exams.wisc.edu/robots.txt
Domain IPs 128.104.252.98
Response IP 128.104.252.98
Found Yes
Hash 56f9715a954707ba95a509d45c284cdf3b503efe4b3c9fd499fdf5b51914ac27
SimHash 5d7498d29342

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Asks bots to index the site less frequently, preventing
  • accidental bot based DDoS.
  • KB Article - https://kb.wisc.edu/webhosting/page.php?id=62214
Back to top