brindley.co.uk
robots.txt

Robots Exclusion Standard data for brindley.co.uk

Resource Scan

Scan Details

Site Domain brindley.co.uk
Base Domain brindley.co.uk
Scan Status Ok
Last Scan2024-10-25T11:02:12+00:00
Next Scan 2024-11-24T11:02:12+00:00

Last Scan

Scanned2024-10-25T11:02:12+00:00
URL https://www.brindley.co.uk/robots.txt
Domain IPs 13.33.88.23, 13.33.88.57, 13.33.88.59, 13.33.88.8, 2600:9000:223b:2a00:1b:36a9:d3c0:93a1, 2600:9000:223b:3000:1b:36a9:d3c0:93a1, 2600:9000:223b:7c00:1b:36a9:d3c0:93a1, 2600:9000:223b:7e00:1b:36a9:d3c0:93a1, 2600:9000:223b:8400:1b:36a9:d3c0:93a1, 2600:9000:223b:a400:1b:36a9:d3c0:93a1, 2600:9000:223b:a600:1b:36a9:d3c0:93a1, 2600:9000:223b:de00:1b:36a9:d3c0:93a1
Response IP 13.33.88.8
Found Yes
Hash 635bb4a0d603c03ad519fd3d89ddacd1cb710794d78ba4cf5c8a3e02cd9164f7
SimHash 032dde414d42

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*
Disallow */backend.*
Disallow */.mh.*
Disallow */id-*
Disallow /*?*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.brindley.co.uk/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk