haloberlin.de
robots.txt

Robots Exclusion Standard data for haloberlin.de

Resource Scan

Scan Details

Site Domain haloberlin.de
Base Domain haloberlin.de
Scan Status Ok
Last Scan2026-03-30T18:34:07+00:00
Next Scan 2026-04-06T18:34:07+00:00

Last Scan

Scanned2026-03-30T18:34:07+00:00
URL https://haloberlin.de/robots.txt
Domain IPs 91.237.52.196
Response IP 91.237.52.196
Found Yes
Hash 410b8b2176d78da0b0f462fe1d12e3701012f87e7e2cab527e8f0cda426c3faf
SimHash 7b1cd8a0cf10

Groups

*

Rule Path
Allow /
Disallow /users/login.html
Disallow /schowek.html

Other Records

Field Value
crawl-delay 900

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 14400

semrushbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 14400