Log In Sign Up

excalibur.co.uk
robots.txt

Robots Exclusion Standard data for excalibur.co.uk

Resource Scan

Scan Details

Site Domain excalibur.co.uk
Base Domain excalibur.co.uk
Scan Status Ok
Last Scan2025-10-29T23:02:02+00:00
Next Scan 2025-11-05T23:02:02+00:00

Last Scan

Scanned2025-10-29T23:02:02+00:00
URL https://excalibur.co.uk/robots.txt
Domain IPs 2a02:4780:38:b3c9:cdf9:4e87:3a5a:dc27, 2a02:4780:39:ee1b:fe62:b108:bb82:ddc9, 84.32.84.65, 84.32.84.96
Response IP 179.61.189.119
Found Yes
Hash 88519c1699b70786a13ec6777781b9a49cd1a44ae86d3f2d8afe9d8d7d13a21c
SimHash b21488209e02

Groups

claudebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

expanse

Rule Path
Disallow /

l9explore

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

custom-asynchttpclient

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

siteuptime

Rule Path
Disallow /

genomecrawlerd

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /
Back to top