Log In Sign Up

blocklist.de
robots.txt

Robots Exclusion Standard data for blocklist.de

Resource Scan

Scan Details

Site Domain blocklist.de
Base Domain blocklist.de
Scan Status Ok
Last Scan2024-06-25T01:50:55+00:00
Next Scan 2024-07-02T01:50:55+00:00

Last Scan

Scanned2024-06-25T01:50:55+00:00
URL https://blocklist.de/robots.txt
Domain IPs 144.76.114.3, 2a01:4f8:192:6414::2
Response IP 144.76.114.3
Found Yes
Hash 28424fa184ba588125a80fe69542c9d6d65f84948b16e1c5a133538332477e2b
SimHash 5b38db2adc90

Groups

spbot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow imprint.html

omniexplorer_bot

Rule Path
Disallow /

www.adressendeutschland.de

Rule Path
Disallow /

west wind internet protocols 4.55

Rule Path
Disallow /

*

Rule Path
Disallow /en/imprint.html
Disallow /de/imprint.html
Disallow /fr/imprint.html
Disallow /en/logs.html
Disallow /de/logs.html

*

Rule Path
Disallow server.html

botonparade

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

pixray

Rule Path
Disallow /

bubing

Rule Path
Disallow /

pixraybot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /
Back to top

Comments

  • robots.txt zu http://www.blocklist.de/
Back to top

Warnings

  • 2 invalid lines.
Back to top