bmstores.co.uk
robots.txt

Robots Exclusion Standard data for bmstores.co.uk

Resource Scan

Scan Details

Site Domain bmstores.co.uk
Base Domain bmstores.co.uk
Scan Status Ok
Last Scan2024-05-01T23:27:08+00:00
Next Scan 2024-05-31T23:27:08+00:00

Last Scan

Scanned2024-05-01T23:27:08+00:00
URL https://bmstores.co.uk/robots.txt
Redirect https://www.bmstores.co.uk:443/robots.txt
Redirect Domain www.bmstores.co.uk
Redirect Base bmstores.co.uk
Domain IPs 99.83.177.244
Redirect IPs 13.33.88.11, 13.33.88.15, 13.33.88.26, 13.33.88.69, 2600:9000:223b:2400:e:d9fa:f740:93a1, 2600:9000:223b:2e00:e:d9fa:f740:93a1, 2600:9000:223b:3600:e:d9fa:f740:93a1, 2600:9000:223b:6000:e:d9fa:f740:93a1, 2600:9000:223b:7800:e:d9fa:f740:93a1, 2600:9000:223b:c800:e:d9fa:f740:93a1, 2600:9000:223b:d200:e:d9fa:f740:93a1, 2600:9000:223b:e000:e:d9fa:f740:93a1
Response IP 13.33.88.15
Found Yes
Hash 7d2f038aed4ee281f9196cd1f030e74ca6063907a09d4d5c7bc1d4f21f0caf5a
SimHash 6f4d8d1345f1

Groups

*

Rule Path
Disallow /farcry/
Disallow /webtop/
Disallow /search
Disallow /*?
Disallow /competition-news/
Disallow /winner-announcement/
Disallow /big-competition/
Allow /competitions$

mj12bot

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bmstores.co.uk/dmnavigation/sitemap
sitemap https://www.bmstores.co.uk/hpcstores/storessitemap

Warnings

  • `host` is not a known field.