Log In Sign Up

www.studium.uni-kiel.de
robots.txt

Robots Exclusion Standard data for www.studium.uni-kiel.de

Resource Scan

Scan Details

Site Domain www.studium.uni-kiel.de
Base Domain uni-kiel.de
Scan Status Ok
Last Scan2025-03-03T19:26:36+00:00
Next Scan 2025-04-02T19:26:36+00:00

Last Scan

Scanned2025-03-03T19:26:36+00:00
URL https://www.studium.uni-kiel.de/robots.txt
Domain IPs 134.245.10.99
Response IP 134.245.10.99
Found Yes
Hash f8f608fdd18986951356c3902bbf528913bb05b4f774e2e9ee52f5b4c850eece
SimHash 84154b05c553

Groups

bingbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

yacybot

Rule Path
Disallow

yandexbot

Rule Path
Disallow

semanticscholarbot

Rule Path
Disallow

applebot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

petalbot

Rule Path
Disallow

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap /sitemap.xml.gz
Back to top

Comments

  • Define access-restrictions for robots/spiders
  • http://www.robotstxt.org/wc/norobots.html
  • Too tired of SEO racketeers.
Back to top