Log In Sign Up

metal-detecting.org.uk
robots.txt

Robots Exclusion Standard data for metal-detecting.org.uk

Resource Scan

Scan Details

Site Domain metal-detecting.org.uk
Base Domain metal-detecting.org.uk
Scan Status Ok
Last Scan2025-10-16T16:51:07+00:00
Next Scan 2025-10-23T16:51:07+00:00

Last Scan

Scanned2025-10-16T16:51:07+00:00
URL https://metal-detecting.org.uk/robots.txt
Domain IPs 104.152.168.200
Response IP 104.152.168.200
Found Yes
Hash 8c5d53fe01d19cdf288700ce0cd56a8a5335f87043bad3b40b36669e753974c5
SimHash 5a74cb733e01

Groups

bubing

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

gluten free crawler

Rule Path
Disallow /

glutenfreecrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /
Back to top