beyersteenber.livejournal.com
robots.txt

Robots Exclusion Standard data for beyersteenber.livejournal.com

Resource Scan

Scan Details

Site Domain beyersteenber.livejournal.com
Base Domain livejournal.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-26T01:49:38+00:00
Next Scan 2025-11-02T01:49:38+00:00

Last Successful Scan

Scanned2025-10-10T20:54:44+00:00
URL https://beyersteenber.livejournal.com/robots.txt
Domain IPs 81.19.74.0, 81.19.74.1
Response IP 81.19.74.0
Found Yes
Hash 18b3013488fa08fc08d25cc94aaa0348efa8b24a04ccc16da0883562faaa26f2
SimHash 4a00c8c2c7b3

Groups

*

Rule Path
Disallow /

yandex

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Warnings

  • `host` is not a known field.