eisenbahn.de
robots.txt
Robots Exclusion Standard data for eisenbahn.de
Resource Scan
Scan Details
Site Domain | eisenbahn.de |
Base Domain | eisenbahn.de |
Scan Status | Ok |
Last Scan | 2025-03-12T19:28:47+00:00 |
Next Scan | 2025-03-19T19:28:47+00:00 |
Last Scan
Scanned | 2025-03-12T19:28:47+00:00 |
URL | https://eisenbahn.de/robots.txt |
Domain IPs | 185.175.196.43, 2a00:1c98:60:1061::92fa:f9af |
Response IP | 185.175.196.43 |
Found | Yes |
Hash | 4832a4d784edc72910e1694f291d4162f8e7b0651d41d7f2ef0a9be5d423172a |
SimHash | 7f080ac184f7 |
Groups
anthropic-ai
claude-web
ccbot
facebookbot
google-extended
gptbot
piplbot
bytespider
omgilibot
omgili
imagesiftbot
bardbot
komobot
meta-externalagent
meta-externalfetcher
diffbot
cohere-ai
timpibot
webzio-extended
youbot
ai2bot
amazonbot
applebot-extended
claudebot
petalbot
webzio
stablediffusionbot
sentibot
grok
grokai
xai
xbot
ai2bot-dolma
cohere-training-data-crawler
duckassistbot
img2dataset
magpie-crawler
pangubot
duckduckbot
openaicontentcrawler
yandexbot
neevabot
aimatrixcrawler
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://eisenbahn.de/sitemap_index.xml |
Comments