michelin.com.au
robots.txt
Robots Exclusion Standard data for michelin.com.au
Resource Scan
Scan Details
Site Domain | michelin.com.au |
Base Domain | michelin.com.au |
Scan Status | Ok |
Last Scan | 2024-10-04T12:01:57+00:00 |
Next Scan | 2024-10-18T12:01:57+00:00 |
Last Scan
Scanned | 2024-10-04T12:01:57+00:00 |
URL | https://michelin.com.au/robots.txt |
Redirect | https://www.michelin.com.au/robots.txt |
Redirect Domain | www.michelin.com.au |
Redirect Base | michelin.com.au |
Domain IPs | 20.43.169.206 |
Redirect IPs | 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c |
Response IP | 152.199.39.108 |
Found | Yes |
Hash | 351e3ae2f02864ac5b40af2e27caf55613556eacffe07013c6b52dccd9f13288 |
SimHash | 572cc3f3f34b |
Groups
*
Rule | Path |
---|---|
Allow | /modules/my-apostrophe-assets/favicon/* |
Disallow | */undefined* |
Disallow | */dealer-locator?selVeiculo= |
Disallow | */tyreShare* |
Disallow | */full$ |
Disallow | *?pageNumber=* |
Disallow | *%26pageNumber%3D* |
Disallow | */tyreSearch/* |
Disallow | *jsessionid%3D* |
Disallow | /tunnelModalAction?modalLink=* |
Disallow | *fromTyreSelector%3D* |
Disallow | */displayDealer.action?* |
Disallow | */relatedMedia.action* |
Disallow | /modules/* |
Disallow | */dealer-locator/*?* |
bingbot
yahoo
yandex
baiduspider
haosouspider
sogou web spider
sogou inst spider
sogou spider2
Rule | Path |
---|---|
Disallow | */undefined* |
Disallow | */dealer-locator?selVeiculo= |
Disallow | */tyreShare* |
Disallow | */full$ |
Disallow | *?pageNumber=* |
Disallow | *%26pageNumber%3D* |
Disallow | */tyreSearch/* |
Disallow | *jsessionid%3D* |
Disallow | /tunnelModalAction?modalLink=* |
Disallow | *fromTyreSelector%3D* |
Disallow | */displayDealer.action?* |
Disallow | */relatedMedia.action* |
Disallow | /modules/* |
Disallow | */dealer-locator/*?* |
Allow | / |
Allow | /modules/my-apostrophe-assets/favicon/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.michelin.com.au/sitemap.xml |
Comments