bergheim.de
robots.txt

Robots Exclusion Standard data for bergheim.de

Resource Scan

Scan Details

Site Domain bergheim.de
Base Domain bergheim.de
Scan Status Ok
Last Scan2025-12-13T03:44:32+00:00
Next Scan 2026-01-12T03:44:32+00:00

Last Scan

Scanned2025-12-13T03:44:32+00:00
URL https://bergheim.de/robots.txt
Redirect https://www.bergheim.de/robots.txt
Redirect Domain www.bergheim.de
Redirect Base bergheim.de
Domain IPs 185.155.109.135, 2001:67c:680:f06::135
Redirect IPs 185.155.109.135, 2001:67c:680:f06::135
Response IP 185.155.109.135
Found Yes
Hash 07c576b444079d486b4650a49dc1a43de4c2bf52e7542962e27b8b0b0ce61f5b
SimHash b61e8311c286

Groups

dotbot
dataforseobot
url_spider_pro
xovi
um-ic
searchpreview
rogerbot
openbot
backlink-check.de
backlinkcrawler
extractorpro
fasterfox
ahrefsbot
mj12bot
semrushbot
img2dataset
amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
claude-web
claudebot
diffbot
cohere-ai
facebookbot
friendlycrawler
imagesiftbot
icc-crawler
youbot
oai-searchbot
meta-externalagent
youbot
velenpublicwebcrawler
timpibot
scrapy
petalbot
omgilibot
omgili
ai2bot
ai2bot-dolma
applebot
duckassistbot
iaskspider/2.0
isscyberriskcrawler
kangaroo bot
meta-externalfetcher
pangubot
perplexitybot
sidetrade indexer bot
webzio-extended

Rule Path
Disallow /