brooksuspension.co.uk
robots.txt

Robots Exclusion Standard data for brooksuspension.co.uk

Resource Scan

Scan Details

Site Domain brooksuspension.co.uk
Base Domain brooksuspension.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/26/2025, 5:33:00 PM
Next Scan 4/27/2025, 5:33:00 PM

Last Successful Scan

Scanned3/27/2025, 3:28:28 PM
URL https://brooksuspension.co.uk/robots.txt
Redirect https://www.brooksuspension.co.uk/robots.txt
Redirect Domain www.brooksuspension.co.uk
Redirect Base brooksuspension.co.uk
Domain IPs 104.21.87.28, 172.67.140.19, 2606:4700:3031::ac43:8c13, 2606:4700:3032::6815:571c
Redirect IPs 104.21.87.28, 172.67.140.19, 2606:4700:3031::ac43:8c13, 2606:4700:3032::6815:571c
Response IP 172.67.140.19
Found Yes
Hash 18c3f3c0bfcc44b36ea82c269cc93a92fe89ae456f992acf6c140471f9493cf3
SimHash edb5f02aeb3b

Groups

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /brand/*
Disallow /media/mageplaza/product_attachments/*
Disallow /mpattachments/*
Disallow /*seal_type%3D
Disallow /*bush_type%3D
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /motorcycle-suspension-brands/

Other Records

Field Value
sitemap https://www.brooksuspension.co.uk/media/masterxml.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-shock-absorber-parts.xml
sitemap https://www.brooksuspension.co.uk/media/masterxml.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-oil.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-seals.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-bushes.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-stanchions-tubes.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-springs.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-internals.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-shock-springs.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-shock-absorbers.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-suspension-tools.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-dymag-wheels.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-workshop.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-merchandise.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-xtrig-preload-adjusters.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-xtrig-triple-clamps.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-seal-circlips.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-fork-travel-indicators.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-paddock-stands.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-steering-dampers.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-engine-oil.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-chains-and-sprockets.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-brakes.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-exhausts.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-clutches.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-bladder-conversion.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-shock-absorber-orvs.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-bolts-nuts-washers.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-linkages.xml
sitemap https://www.brooksuspension.co.uk/media/sitemap/sitemap-forks.xml