Log In Sign Up

bayv.co.uk
robots.txt

Robots Exclusion Standard data for bayv.co.uk

Resource Scan

Scan Details

Site Domain bayv.co.uk
Base Domain bayv.co.uk
Scan Status Ok
Last Scan2026-01-21T14:12:56+00:00
Next Scan 2026-02-20T14:12:56+00:00

Last Scan

Scanned2026-01-21T14:12:56+00:00
URL http://bayv.co.uk/robots.txt
Domain IPs 52.16.25.241
Response IP 52.16.25.241
Found Yes
Hash 89704d1137aabeec93afa037dc8dbb403ff6af09f464c977e16e2a1b28712f1b
SimHash 4057f512211b

Groups

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*?

googlebot

Rule Path
Disallow /*.html?$

googlebot

Rule Path
Disallow /*.php$

googlebot

Rule Path
Disallow /*.aspx?$

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

applebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /
Back to top