mercedes-benz-mena.com
robots.txt

Robots Exclusion Standard data for mercedes-benz-mena.com

Resource Scan

Scan Details

Site Domain mercedes-benz-mena.com
Base Domain mercedes-benz-mena.com
Scan Status Ok
Last Scan2024-05-08T15:21:21+00:00
Next Scan 2024-06-07T15:21:21+00:00

Last Scan

Scanned2024-05-08T15:21:21+00:00
URL https://www.mercedes-benz-mena.com/robots.txt
Domain IPs 54.192.18.103, 54.192.18.44, 54.192.18.46, 54.192.18.80
Response IP 13.225.4.9
Found Yes
Hash f9ae8b275d0aec1503ec9e89306f391174ad0f094fbef70195ec5eabf6e8a184
SimHash 8b0dda03cd43

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mercedes-benz-mena.com/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk