usedcarsalesdirect.co.uk
robots.txt

Robots Exclusion Standard data for usedcarsalesdirect.co.uk

Resource Scan

Scan Details

Site Domain usedcarsalesdirect.co.uk
Base Domain usedcarsalesdirect.co.uk
Scan Status Ok
Last Scan2024-10-23T22:46:12+00:00
Next Scan 2024-11-22T22:46:12+00:00

Last Scan

Scanned2024-10-23T22:46:12+00:00
URL https://www.usedcarsalesdirect.co.uk/robots.txt
Domain IPs 108.157.254.117, 108.157.254.13, 108.157.254.74, 108.157.254.88, 2600:9000:2753:6e00:6:3e40:3900:93a1, 2600:9000:2753:7e00:6:3e40:3900:93a1, 2600:9000:2753:8600:6:3e40:3900:93a1, 2600:9000:2753:9400:6:3e40:3900:93a1, 2600:9000:2753:a600:6:3e40:3900:93a1, 2600:9000:2753:b000:6:3e40:3900:93a1, 2600:9000:2753:dc00:6:3e40:3900:93a1, 2600:9000:2753:f200:6:3e40:3900:93a1
Response IP 108.157.254.88
Found Yes
Hash 365d30b19508af05b60457a5bd2711be8191b1419a0cab774d45016ef65c206b
SimHash 8b0ddb43ed43

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.usedcarsalesdirect.co.uk/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk