main-echo.de
robots.txt

Robots Exclusion Standard data for main-echo.de

Resource Scan

Scan Details

Site Domain main-echo.de
Base Domain main-echo.de
Scan Status Ok
Last Scan2025-12-12T18:35:43+00:00
Next Scan 2025-12-19T18:35:43+00:00

Last Scan

Scanned2025-12-12T18:35:43+00:00
URL https://main-echo.de/robots.txt
Redirect https://www.main-echo.de/robots.txt
Redirect Domain www.main-echo.de
Redirect Base main-echo.de
Domain IPs 82.211.32.81
Redirect IPs 82.211.32.243
Response IP 82.211.32.243
Found Yes
Hash 7cb1186b18744ba1e4c79b737ced4ab666ca546c436ef2f2fdfae9f6b7e35773
SimHash b35aeb115e82

Groups

ogdwctxcrawler
facebookbot
amazonadbot
facebookexternalhit

Rule Path
Disallow

addsearchbot
ai2bot
ai2bot-dolma
aihitbot
amazonbuyforme
atlassian-bot
amazon-kendra-
amazonbot
andibot
anomura
anthropic-ai
applebot
applebot-extended
awario
bedrockbot
bigsur.ai
bravebot
brightbot 1.0
buddybot
bytespider
ccbot
chatgpt agent
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cloudflare-autorag
cloudvertexbot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
datenbank crawler
deepseekbot
devin
diffbot
duckassistbot
echobot bot
echoboxbot
factset_spyderbot
firecrawlagent
friendlycrawler
gemini-deep-research
google-cloudvertexbot
google-extended
google-firebase
google-notebooklm
googleagent-mariner
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
iboubot
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
klaviyoaibot
linerbot
linguee bot
meta-externalagent
meta-externalagent
meta-externalfetcher
meta-externalfetcher
meta-webindexer
mistralai-user
mistralai-user/1.0
mycentralaiscraperbot
netestate imprint crawler
notebooklm
novaact
oai-searchbot
omgili
omgilibot
openai
operator
pangubot
panscient
panscient.com
perplexity-user
perplexitybot
petalbot
phindbot
poseidon research crawler
qualifiedbot
quillbot
quillbot.com
sbintuitionsbot
scrapy
semrushbot-ocob
semrushbot-swa
shapbot
sidetrade indexer bot
terracotta
thinkbot
tiktokspider
timpibot
velenpublicwebcrawler
wardbot
webzio-extended
wpbot
yak
yandexadditional
yandexadditionalbot
youbot

Rule Path
Disallow /

*

Rule Path
Disallow /unternehmen/nativendo/
Disallow /technical-support/
Disallow /storage/epa/
Disallow /mntest/
Disallow /import/
Disallow /alter-content/
Disallow /demo/
Disallow /mobil/
Disallow /pressespiegel/
Disallow /admin/
Disallow /_/admin/
Disallow /_fWS/json/epaper/

googlebot-news

Rule Path
Disallow /mediathek/
Disallow /anzeigen/
Disallow /abo-service/
Disallow /e-paper/
Disallow /verlag/
Disallow /unternehmen/
Disallow /objects/
Disallow /_/

Comments

  • ID: 1
  • Speziell weitere Ressorts fuer den Google-news Bot...
  • Legal notice: www.main-echo.de expressly reserves the right to use its content for commercial text and data mining (ยง 44b UrhG).
  • The use of robots or other automated means to access www.main-echo.de or collect or mine data without the express permission of www.main-echo.de is strictly prohibited.
  • If you would like to apply for permission to crawl www.main-echo.de, collect or use data, please contact admin@main-echo.de