herole.de
robots.txt

Robots Exclusion Standard data for herole.de

Resource Scan

Scan Details

Site Domain herole.de
Base Domain herole.de
Scan Status Ok
Last Scan2025-12-31T17:51:08+00:00
Next Scan 2026-01-30T17:51:08+00:00

Last Scan

Scanned2025-12-31T17:51:08+00:00
URL https://herole.de/robots.txt
Redirect https://www.herole.de/robots.txt
Redirect Domain www.herole.de
Redirect Base herole.de
Domain IPs 217.154.160.99
Redirect IPs 217.154.160.99
Response IP 217.154.160.99
Found Yes
Hash 1628fb12248dbdc64bed7413f8d14c576bafb0f23f9a23fd89d0d8901e46be1c
SimHash a49f7909c655

Groups

israbot
orthogaffe
ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper

Rule Path
Disallow /

googlebot
slurp
bingbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.herole.de/sitemap.xml
sitemap https://www.herole.de/blog/sitemap_index.xml