riversidemotors.co.uk
robots.txt

Robots Exclusion Standard data for riversidemotors.co.uk

Resource Scan

Scan Details

Site Domain riversidemotors.co.uk
Base Domain riversidemotors.co.uk
Scan Status Ok
Last Scan2024-11-03T16:09:28+00:00
Next Scan 2024-12-03T16:09:28+00:00

Last Scan

Scanned2024-11-03T16:09:28+00:00
URL https://www.riversidemotors.co.uk/robots.txt
Domain IPs 13.33.30.124, 13.33.30.16, 13.33.30.7, 13.33.30.96, 2600:9000:229f:2000:1f:fab3:8100:93a1, 2600:9000:229f:3800:1f:fab3:8100:93a1, 2600:9000:229f:3c00:1f:fab3:8100:93a1, 2600:9000:229f:3e00:1f:fab3:8100:93a1, 2600:9000:229f:5600:1f:fab3:8100:93a1, 2600:9000:229f:6000:1f:fab3:8100:93a1, 2600:9000:229f:7200:1f:fab3:8100:93a1, 2600:9000:229f:a400:1f:fab3:8100:93a1
Response IP 13.33.30.7
Found Yes
Hash 425833d8b1affcb40dd0c677585a3a0d4a6e2c093c64a4ba332c635d74344ec7
SimHash 890dde41cd42

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.riversidemotors.co.uk/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk