petromin-stellantis.com
robots.txt

Robots Exclusion Standard data for petromin-stellantis.com

Resource Scan

Scan Details

Site Domain petromin-stellantis.com
Base Domain petromin-stellantis.com
Scan Status Ok
Last Scan2024-11-02T21:55:45+00:00
Next Scan 2024-12-02T21:55:45+00:00

Last Scan

Scanned2024-11-02T21:55:45+00:00
URL https://www.petromin-stellantis.com/robots.txt
Domain IPs 108.157.254.17, 108.157.254.22, 108.157.254.44, 108.157.254.86, 2600:9000:2753:200:14:d7aa:6840:93a1, 2600:9000:2753:400:14:d7aa:6840:93a1, 2600:9000:2753:7a00:14:d7aa:6840:93a1, 2600:9000:2753:8e00:14:d7aa:6840:93a1, 2600:9000:2753:9a00:14:d7aa:6840:93a1, 2600:9000:2753:c00:14:d7aa:6840:93a1, 2600:9000:2753:ea00:14:d7aa:6840:93a1, 2600:9000:2753:ec00:14:d7aa:6840:93a1
Response IP 108.157.254.86
Found Yes
Hash 0e50c3bdbe4b7b7bc6c069260b67b4a912b46a2c0209daf95fcf04b05e9b0f49
SimHash 8b0dde43cdc2

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.petromin-stellantis.com/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk