mazdausedcarlocator.co.uk
robots.txt

Robots Exclusion Standard data for mazdausedcarlocator.co.uk

Resource Scan

Scan Details

Site Domain mazdausedcarlocator.co.uk
Base Domain mazdausedcarlocator.co.uk
Scan Status Ok
Last Scan2024-09-29T07:36:05+00:00
Next Scan 2024-10-29T07:36:05+00:00

Last Scan

Scanned2024-09-29T07:36:05+00:00
URL https://www.mazdausedcarlocator.co.uk/robots.txt
Domain IPs 108.156.133.107, 108.156.133.120, 108.156.133.88, 108.156.133.92, 2600:9000:2755:6400:18:fb60:7d80:93a1, 2600:9000:2755:7e00:18:fb60:7d80:93a1, 2600:9000:2755:9200:18:fb60:7d80:93a1, 2600:9000:2755:a600:18:fb60:7d80:93a1, 2600:9000:2755:ac00:18:fb60:7d80:93a1, 2600:9000:2755:c000:18:fb60:7d80:93a1, 2600:9000:2755:d600:18:fb60:7d80:93a1, 2600:9000:2755:e800:18:fb60:7d80:93a1
Response IP 108.156.133.88
Found Yes
Hash c3496d9c7a44c1f0c59317697c3a686c3a1aad5df0b0a0a50a6eeeed2a165e0e
SimHash 890dde43cd43

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mazdausedcarlocator.co.uk/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk