vwbreakers.co.uk
robots.txt

Robots Exclusion Standard data for vwbreakers.co.uk

Resource Scan

Scan Details

Site Domain vwbreakers.co.uk
Base Domain vwbreakers.co.uk
Scan Status Ok
Last Scan2025-09-26T17:32:39+00:00
Next Scan 2025-10-03T17:32:39+00:00

Last Scan

Scanned2025-09-26T17:32:39+00:00
URL https://vwbreakers.co.uk/robots.txt
Redirect https://www.vwbreakers.co.uk/robots.txt
Redirect Domain www.vwbreakers.co.uk
Redirect Base vwbreakers.co.uk
Domain IPs 104.21.37.44, 172.67.203.190, 2606:4700:3032::ac43:cbbe, 2606:4700:3036::6815:252c
Redirect IPs 104.21.37.44, 172.67.203.190, 2606:4700:3032::ac43:cbbe, 2606:4700:3036::6815:252c
Response IP 104.21.37.44
Found Yes
Hash 8fe2071ddf00d7f22368c047307adaa2236c7e099103e6cb00c090f456048e95
SimHash 69019b02cd90

Groups

*

Rule Path
Disallow /checkout-complete

Other Records

Field Value
sitemap https://www.vwbreakers.co.uk/page-sitemap.xml
sitemap https://www.vwbreakers.co.uk/listing-sitemap.xml

Comments

  • Block all robots from tmp and logs directories