Log In Sign Up

uni-weimar.de
robots.txt

Robots Exclusion Standard data for uni-weimar.de

Resource Scan

Scan Details

Site Domain uni-weimar.de
Base Domain uni-weimar.de
Scan Status Ok
Last Scan2024-06-03T18:28:32+00:00
Next Scan 2024-07-03T18:28:32+00:00

Last Scan

Scanned2024-06-03T18:28:32+00:00
URL https://uni-weimar.de/robots.txt
Redirect https://www.uni-weimar.de/robots.txt
Redirect Domain www.uni-weimar.de
Redirect Base uni-weimar.de
Domain IPs 141.54.1.34
Redirect IPs 141.54.1.34
Response IP 141.54.1.34
Found Yes
Hash dce797e81f3df42cb7fef2ee454ba2a2de3506c6ae24fbad7c5cac601a9895a2
SimHash 7b42c0a283b3

Groups

ahrefsbot

Rule Path
Disallow /

python-urllib/1.17

Rule Path
Disallow /

msnbot-udiscovery

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

webmeasurement-bot

Rule Path
Disallow /

sogou
*

Rule Path
Disallow /typo3conf/
Disallow /de/universitaet/aktuell/pinnwaende/
Disallow /en/university/news/message-boards/
Disallow /de/fs/
Disallow /en/fs/
Back to top

Comments

  • User-agent: Yandex
  • Disallow: /
Back to top