mercedes-benz.no
robots.txt

Robots Exclusion Standard data for mercedes-benz.no

Resource Scan

Scan Details

Site Domain mercedes-benz.no
Base Domain mercedes-benz.no
Scan Status Ok
Last Scan2024-09-18T04:18:00+00:00
Next Scan 2024-10-18T04:18:00+00:00

Last Scan

Scanned2024-09-18T04:18:00+00:00
URL https://www.mercedes-benz.no/robots.txt
Domain IPs 108.157.254.35, 108.157.254.45, 108.157.254.61, 108.157.254.77, 2600:9000:2014:1400:14:e29b:2100:93a1, 2600:9000:2014:4400:14:e29b:2100:93a1, 2600:9000:2014:5400:14:e29b:2100:93a1, 2600:9000:2014:7400:14:e29b:2100:93a1, 2600:9000:2014:9a00:14:e29b:2100:93a1, 2600:9000:2014:ca00:14:e29b:2100:93a1, 2600:9000:2014:e000:14:e29b:2100:93a1, 2600:9000:2014:fc00:14:e29b:2100:93a1
Response IP 108.157.254.45
Found Yes
Hash 4d2d5f3d6a01a0738b9863fa5a30c3111f56932083e8b788abb9d3b7593fd707
SimHash 894ddf51cd53

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mercedes-benz.no/sitemap.xml.gz
sitemap https://www.mercedes-benz.no/css-sitemap/no-no

Comments

  • robots.txt generated at http://www.gforces.co.uk