kingfishers.com
robots.txt

Robots Exclusion Standard data for kingfishers.com

Resource Scan

Scan Details

Site Domain kingfishers.com
Base Domain kingfishers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-17T07:44:02+00:00
Next Scan 2025-12-01T07:44:02+00:00

Last Successful Scan

Scanned2025-11-01T12:51:26+00:00
URL https://kingfishers.com/robots.txt
Domain IPs 2a02:4780:84:2932:f48a:775:3332:bb42, 2a02:4780:84:4d0c:1e8d:3b8f:578a:fcd1, 84.32.84.238, 84.32.84.88
Response IP 93.127.187.171
Found Yes
Hash 88519c1699b70786a13ec6777781b9a49cd1a44ae86d3f2d8afe9d8d7d13a21c
SimHash b21488209e02

Groups

claudebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

expanse

Rule Path
Disallow /

l9explore

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

custom-asynchttpclient

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

siteuptime

Rule Path
Disallow /

genomecrawlerd

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /