lurkmore.me
robots.txt

Robots Exclusion Standard data for lurkmore.me

Resource Scan

Scan Details

Site Domain lurkmore.me
Base Domain lurkmore.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-19T12:12:49+00:00
Next Scan 2025-10-17T12:12:49+00:00

Last Successful Scan

Scanned2025-03-22T00:31:48+00:00
URL https://lurkmore.me/robots.txt
Domain IPs 104.21.57.209, 172.67.149.242, 2606:4700:3030::6815:39d1, 2606:4700:3030::ac43:95f2
Response IP 104.21.57.209
Found Yes
Hash b9375f7f1bfec47ec6a3bbff279c264bbe22ce2ac82671693c1909415e668193
SimHash c1549800c171

Groups

bytespider

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow