Log In Sign Up

ich-tanke.de
robots.txt

Robots Exclusion Standard data for ich-tanke.de

Resource Scan

Scan Details

Site Domain ich-tanke.de
Base Domain ich-tanke.de
Scan Status Ok
Last Scan2024-10-21T09:38:05+00:00
Next Scan 2024-11-20T09:38:05+00:00

Last Scan

Scanned2024-10-21T09:38:05+00:00
URL https://ich-tanke.de/robots.txt
Domain IPs 2001:4ba0:92e0:190::1, 80.82.223.190
Response IP 80.82.223.190
Found Yes
Hash 7bab5acc3518f53009b31a7080820a29bfc7fc115b47181f003f31ec4483685f
SimHash c215d5241757

Groups

emailcollector

Rule Path
Disallow /

gagarobot

Rule Path
Disallow /

vscooter

Rule Path
Disallow /

roverbot*

Rule Path
Disallow /

mirago

Rule Path
Disallow /

psbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

webcapture*

Rule Path
Disallow /

websauger*

Rule Path
Disallow /

teleport*

Rule Path
Disallow /

webwhacker*

Rule Path
Disallow /

webzip*

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

net attache*

Rule Path
Disallow /

webreaper*

Rule Path
Disallow /

sitesnagger*

Rule Path
Disallow /

httrack*

Rule Path
Disallow /
Back to top