bmw-abudhabi.com
robots.txt

Robots Exclusion Standard data for bmw-abudhabi.com

Resource Scan

Scan Details

Site Domain bmw-abudhabi.com
Base Domain bmw-abudhabi.com
Scan Status Ok
Last Scan2024-11-16T06:03:52+00:00
Next Scan 2024-12-16T06:03:52+00:00

Last Scan

Scanned2024-11-16T06:03:52+00:00
URL https://www.bmw-abudhabi.com/robots.txt
Domain IPs 18.244.51.104, 18.244.51.122, 18.244.51.48, 18.244.51.55, 2600:9000:23d2:2a00:16:ce67:a6c0:93a1, 2600:9000:23d2:3200:16:ce67:a6c0:93a1, 2600:9000:23d2:4200:16:ce67:a6c0:93a1, 2600:9000:23d2:5e00:16:ce67:a6c0:93a1, 2600:9000:23d2:8000:16:ce67:a6c0:93a1, 2600:9000:23d2:9600:16:ce67:a6c0:93a1, 2600:9000:23d2:9800:16:ce67:a6c0:93a1, 2600:9000:23d2:d400:16:ce67:a6c0:93a1
Response IP 18.155.68.58
Found Yes
Hash f5bdc1a355f3d3522bcadc1e544cdf7a94163a17b467d68e95087059161b197d
SimHash 890ddb01cd42

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bmw-abudhabi.com/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk