deutsche-rechtschreibung.org
robots.txt

Robots Exclusion Standard data for deutsche-rechtschreibung.org

Resource Scan

Scan Details

Site Domain deutsche-rechtschreibung.org
Base Domain deutsche-rechtschreibung.org
Scan Status Ok
Last Scan2025-12-01T10:56:27+00:00
Next Scan 2025-12-08T10:56:27+00:00

Last Scan

Scanned2025-12-01T10:56:27+00:00
URL http://deutsche-rechtschreibung.org/robots.txt
Domain IPs 92.51.162.160
Response IP 92.51.162.160
Found Yes
Hash ac0e53e3a24f27bd5e43f748eb76b2e86c646b0f367e28c0010938cef537f82f
SimHash 961d76781eb3

Groups

*

Rule Path
Disallow /images/
Disallow /impressum.php

ia_archiver

Rule Path
Disallow /

wget
webzip
webmirror
webcopy

Rule Path
Disallow /

iccrawler - icjobs
turnitinbot
wotbox
acoon
grapeshot
sistrix
proximic
careerbot
baiduspider
baiduspider-image
mj12bot
wbsearchbot
dotbot
obot
ahrefsbot

Rule Path
Disallow /

Comments

  • archive.org sperren
  • Downloader
  • weitere Bots

Warnings

  • 1 invalid line.