clarksofkidderminster.co.uk
robots.txt

Robots Exclusion Standard data for clarksofkidderminster.co.uk

Resource Scan

Scan Details

Site Domain clarksofkidderminster.co.uk
Base Domain clarksofkidderminster.co.uk
Scan Status Ok
Last Scan2026-01-24T03:54:20+00:00
Next Scan 2026-02-23T03:54:20+00:00

Last Scan

Scanned2026-01-24T03:54:20+00:00
URL https://clarksofkidderminster.co.uk/robots.txt
Domain IPs 104.26.2.150, 104.26.3.150, 172.67.71.166, 2606:4700:20::681a:296, 2606:4700:20::681a:396, 2606:4700:20::ac43:47a6
Response IP 104.26.3.150
Found Yes
Hash a0aa707f0ad7441fcc4bdfc111d1d27d5b0b466c180ca9f7a3cc7d0be2ffd8be
SimHash e9159d504ef3

Groups

*

Rule Path
Disallow /?u=
Disallow /ajax
Disallow /search
Disallow /qr/
Disallow /Webservice
Disallow /SearchService
Disallow /print/used-cars
Disallow /preview

ahrefsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semaltspider

Rule Path
Disallow /

badbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.clarksofkidderminster.co.uk/sitemap.xml