berlet.de
robots.txt

Robots Exclusion Standard data for berlet.de

Resource Scan

Scan Details

Site Domain berlet.de
Base Domain berlet.de
Scan Status Ok
Last Scan2024-10-25T10:30:45+00:00
Next Scan 2024-11-24T10:30:45+00:00

Last Scan

Scanned2024-10-25T10:30:45+00:00
URL https://berlet.de/robots.txt
Domain IPs 217.198.127.122
Response IP 217.198.127.122
Found Yes
Hash 929499b6d297cc580b7a4038395c983b1505a35815344cce14be4c0def989bbd
SimHash d90d9040ff90

Groups

*

Rule Path
Disallow /search-detail.htm
Disallow /99999sdf976sdfsdf86786786sadsdf78768sdfsds67_OFF.htm
Disallow /*/customer-email-request-logout_OFF.htm
Disallow /*/customer-email-request_OFFF.htm
Disallow /*/customer-reset-pass.htm
Disallow /amzn-pay-failed.htm

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.berlet.de/sitemap.xml