mercedes-benz.com.az
robots.txt

Robots Exclusion Standard data for mercedes-benz.com.az

Resource Scan

Scan Details

Site Domain mercedes-benz.com.az
Base Domain mercedes-benz.com.az
Scan Status Ok
Last Scan2024-08-30T02:35:15+00:00
Next Scan 2024-09-29T02:35:15+00:00

Last Scan

Scanned2024-08-30T02:35:15+00:00
URL https://www.mercedes-benz.com.az/robots.txt
Domain IPs 13.33.88.129, 13.33.88.18, 13.33.88.46, 13.33.88.89, 2600:9000:223b:1e00:a:f3aa:4340:93a1, 2600:9000:223b:3c00:a:f3aa:4340:93a1, 2600:9000:223b:600:a:f3aa:4340:93a1, 2600:9000:223b:7e00:a:f3aa:4340:93a1, 2600:9000:223b:9a00:a:f3aa:4340:93a1, 2600:9000:223b:c200:a:f3aa:4340:93a1, 2600:9000:223b:ca00:a:f3aa:4340:93a1, 2600:9000:223b:d600:a:f3aa:4340:93a1
Response IP 13.33.88.18
Found Yes
Hash 25a292a504b5df28b258f84bc5ea485f038e76919000cdce5faf48ccb06eda55
SimHash 0b0dd741cd52

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mercedes-benz.com.az/sitemap.xml.gz
sitemap https://www.mercedes-benz.com.az/css-sitemap/ru-az

Comments

  • robots.txt generated at http://www.gforces.co.uk