bennettrenault.co.uk
robots.txt

Robots Exclusion Standard data for bennettrenault.co.uk

Resource Scan

Scan Details

Site Domain bennettrenault.co.uk
Base Domain bennettrenault.co.uk
Scan Status Ok
Last Scan2024-09-08T09:30:04+00:00
Next Scan 2024-10-08T09:30:04+00:00

Last Scan

Scanned2024-09-08T09:30:04+00:00
URL https://www.bennettrenault.co.uk/robots.txt
Domain IPs 13.35.18.26, 13.35.18.50, 13.35.18.70, 13.35.18.96, 2600:9000:20c7:1800:f:5bf0:400:93a1, 2600:9000:20c7:3e00:f:5bf0:400:93a1, 2600:9000:20c7:6600:f:5bf0:400:93a1, 2600:9000:20c7:8a00:f:5bf0:400:93a1, 2600:9000:20c7:ae00:f:5bf0:400:93a1, 2600:9000:20c7:b400:f:5bf0:400:93a1, 2600:9000:20c7:c000:f:5bf0:400:93a1, 2600:9000:20c7:da00:f:5bf0:400:93a1
Response IP 13.35.18.50
Found Yes
Hash 3c17b2dd07430a8feb1b4ad68308935306bf7df2f5d82fb7c98a4cfd1b6cf0cf
SimHash 810bda014d53

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bennettrenault.co.uk/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk