abc-webtools.de
robots.txt

Robots Exclusion Standard data for abc-webtools.de

Resource Scan

Scan Details

Site Domain abc-webtools.de
Base Domain abc-webtools.de
Scan Status Ok
Last Scan2025-08-27T13:59:56+00:00
Next Scan 2025-09-03T13:59:56+00:00

Last Scan

Scanned2025-08-27T13:59:56+00:00
URL https://abc-webtools.de/robots.txt
Redirect https://www.abc-webtools.de/robots.txt
Redirect Domain www.abc-webtools.de
Redirect Base abc-webtools.de
Domain IPs 81.169.230.209
Redirect IPs 81.169.230.209
Response IP 81.169.230.209
Found Yes
Hash 16a32fad7693ee082a847706205b02887ebc15d5cbba2b73f716df0c86c27060
SimHash 4e44d4344343

Groups

*

Rule Path
Disallow /dateien/

wget

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10