www.physik.uzh.ch
robots.txt

Robots Exclusion Standard data for www.physik.uzh.ch

Resource Scan

Scan Details

Site Domain www.physik.uzh.ch
Base Domain uzh.ch
Scan Status Ok
Last Scan2025-05-22T05:04:22+00:00
Next Scan 2025-06-21T05:04:22+00:00

Last Scan

Scanned2025-05-22T05:04:22+00:00
URL https://www.physik.uzh.ch/robots.txt
Domain IPs 130.60.164.18
Response IP 130.60.164.18
Found Yes
Hash 942c7971ef232a39d1df2bf9df213c719a062d5799d75ef4e15f60f685a16e3e
SimHash 3544c060cd63

Groups

*

Rule Path
Disallow /manual/
Disallow /doc/
Disallow /gif/
Disallow /tiff/
Disallow /cgi-bin/

susedig

Rule Path
Disallow

stress-agent

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

Comments

  • exclude help system from robots
  • but allow htdig to index our doc-tree
  • disallow stress test
  • disallow msnbot