mtdparts.ca
robots.txt
Robots Exclusion Standard data for mtdparts.ca
Resource Scan
Scan Details
Site Domain | mtdparts.ca |
Base Domain | mtdparts.ca |
Scan Status | Ok |
Last Scan | 2024-09-22T22:00:08+00:00 |
Next Scan | 2024-10-22T22:00:08+00:00 |
Last Scan
Scanned | 2024-09-22T22:00:08+00:00 |
URL | https://mtdparts.ca/robots.txt |
Redirect | https://www.mtdparts.ca/robots.txt |
Redirect Domain | www.mtdparts.ca |
Redirect Base | mtdparts.ca |
Domain IPs | 23.215.7.16, 23.215.7.20, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:714 |
Redirect IPs | 104.19.212.71, 104.19.213.71 |
Response IP | 104.19.213.71 |
Found | Yes |
Hash | 098b6c9359723dab34e1811c3cd8a0c89c36ed3dcbc14dfdf22eb1a1471de7b7 |
SimHash | 2d8d5804f5d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /checkout |
Disallow | /api |
Disallow | /?ecid |
Disallow | /legal |
Disallow | /inStockRefinement |
Disallow | /dwrExclusiveRefinement |
Disallow | /size |
Disallow | */Product-Variation |
Disallow | */Product-ShowQuickView |
Disallow | *prefn1 |
Disallow | /?q |
Disallow | *?showMap |
Disallow | */Search-UpdateGrid?cgid |
Disallow | */?fitsOnModel |
Disallow | /*pmin* |
Disallow | /*pmax* |
Disallow | /*prefn1* |
Disallow | /*prefn2* |
Disallow | /*prefn3* |
Disallow | /*prefn4* |
Disallow | /*prefv1* |
Disallow | /*prefv2* |
Disallow | /*prefv3* |
Disallow | /*prefv4* |
Disallow | /*srule* |
Other Records
Field | Value |
---|---|
sitemap | https://www.mtdparts.ca/sitemap_index.xml |