stroeer.de
robots.txt

Robots Exclusion Standard data for stroeer.de

Resource Scan

Scan Details

Site Domain stroeer.de
Base Domain stroeer.de
Scan Status Ok
Last Scan2026-03-30T08:44:30+00:00
Next Scan 2026-04-29T08:44:30+00:00

Last Scan

Scanned2026-03-30T08:44:30+00:00
URL https://stroeer.de/robots.txt
Redirect https://www.stroeer.de/robots.txt
Redirect Domain www.stroeer.de
Redirect Base stroeer.de
Domain IPs 104.20.21.143, 172.66.149.109, 2606:4700:10::6814:158f, 2606:4700:10::ac42:956d
Redirect IPs 104.20.21.143, 172.66.149.109, 2606:4700:10::6814:158f, 2606:4700:10::ac42:956d
Response IP 172.66.149.109
Found Yes
Hash 2bed50fb87d8669fdf94c567f088a38844766a3c7dcf846e34a9a1714e89b6f0
SimHash 331ccb68d3b2

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

publicnow

Rule Path
Disallow /newsroom/blog

ioncrawl

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /newsroom/blog

*

Rule Path
Disallow /typo3/
Disallow /typo3_src/
Disallow /newsroom/blog

Other Records

Field Value
crawl-delay 120