bmw-qatar.com
robots.txt

Robots Exclusion Standard data for bmw-qatar.com

Resource Scan

Scan Details

Site Domain bmw-qatar.com
Base Domain bmw-qatar.com
Scan Status Ok
Last Scan2024-09-17T04:26:02+00:00
Next Scan 2024-10-17T04:26:02+00:00

Last Scan

Scanned2024-09-17T04:26:02+00:00
URL https://www.bmw-qatar.com/robots.txt
Domain IPs 13.33.88.16, 13.33.88.33, 13.33.88.48, 13.33.88.96, 2600:9000:223b:2800:9:7d30:4680:93a1, 2600:9000:223b:2a00:9:7d30:4680:93a1, 2600:9000:223b:5800:9:7d30:4680:93a1, 2600:9000:223b:5c00:9:7d30:4680:93a1, 2600:9000:223b:8e00:9:7d30:4680:93a1, 2600:9000:223b:ae00:9:7d30:4680:93a1, 2600:9000:223b:ca00:9:7d30:4680:93a1, 2600:9000:223b:fa00:9:7d30:4680:93a1
Response IP 13.33.88.48
Found Yes
Hash 1a2cf7a000200eac4e0aa3853f0d64e3393989f5da410801eaeea8dd82a46b23
SimHash 8b0dda01cdc3

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bmw-qatar.com/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk