uni-hildesheim.de
robots.txt

Robots Exclusion Standard data for uni-hildesheim.de

Resource Scan

Scan Details

Site Domain uni-hildesheim.de
Base Domain uni-hildesheim.de
Scan Status Ok
Last Scan2024-09-19T16:10:51+00:00
Next Scan 2024-10-19T16:10:51+00:00

Last Scan

Scanned2024-09-19T16:10:51+00:00
URL https://uni-hildesheim.de/robots.txt
Redirect https://www.uni-hildesheim.de/robots.txt
Redirect Domain www.uni-hildesheim.de
Redirect Base uni-hildesheim.de
Domain IPs 147.172.2.52
Redirect IPs 147.172.2.2, 147.172.2.52
Response IP 147.172.2.2
Found Yes
Hash 5750e8daf7f27bbd65e0c9edee5d93323ce8d2a36576a1f075c7f875a37972ac
SimHash 43651801224b

Groups

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yoozbot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

*

Rule Path
Disallow /amidb/
Disallow /en/personal/
Disallow /intranet/
Disallow /mimor/
Disallow /no_cache/
Disallow /personal/
Disallow /rztest/
Disallow /rz/DOC/
Disallow /rz/postgresql/
Disallow /rz/perl/
Disallow /wiki/

Comments

  • robots.txt fuer http://www.uni-hildesheim.de
  • erstellt am 13.3.2014, webmaster@uni-hildesheim.de
  • geaendert 07.06.2017 ojo
  • geaendert 25.11.2017 ht
  • jumpgate /data/web