Log In Sign Up

bahnreiseladen.de
robots.txt

Robots Exclusion Standard data for bahnreiseladen.de

Resource Scan

Scan Details

Site Domain bahnreiseladen.de
Base Domain bahnreiseladen.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-25T00:33:58+00:00
Next Scan 2025-12-24T00:33:58+00:00

Last Successful Scan

Scanned2025-05-21T10:56:44+00:00
URL https://bahnreiseladen.de/robots.txt
Redirect https://www.bahnreiseladen.de/robots.txt
Redirect Domain www.bahnreiseladen.de
Redirect Base bahnreiseladen.de
Domain IPs 104.21.69.5, 172.67.202.37, 2606:4700:3030::ac43:ca25, 2606:4700:3037::6815:4505
Redirect IPs 104.21.69.5, 172.67.202.37, 2606:4700:3030::ac43:ca25, 2606:4700:3037::6815:4505
Response IP 172.67.202.37
Found Yes
Hash 7866c0c24108bbd6f285415239643ae6e6a0f9b988b3a89ebddb52d6f8305004
SimHash 5317c0e3c580

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

oai-searchbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

amazonbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30
Back to top

Other Records

Field Value
sitemap https://api.happyrail.com/sitemaps/bahnreiseladende-sitemapindex.xml
sitemap https://api.happyrail.com/sitemaps/bahnreiseladende-trains-sitemapindex.xml
Back to top