mtdparts.com
robots.txt
Robots Exclusion Standard data for mtdparts.com
Resource Scan
Scan Details
Site Domain | mtdparts.com |
Base Domain | mtdparts.com |
Scan Status | Ok |
Last Scan | 2024-11-16T05:25:55+00:00 |
Next Scan | 2024-12-16T05:25:55+00:00 |
Last Scan
Scanned | 2024-11-16T05:25:55+00:00 |
URL | https://mtdparts.com/robots.txt |
Redirect | https://www.mtdparts.com/robots.txt |
Redirect Domain | www.mtdparts.com |
Redirect Base | mtdparts.com |
Domain IPs | 23.215.7.16, 23.215.7.20, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:714 |
Redirect IPs | 104.19.152.81, 104.19.153.81 |
Response IP | 104.19.153.81 |
Found | Yes |
Hash | 414ce7d7167d1df45fab5aa3fae9e8971334b10e31df796795d5884bd0821ad4 |
SimHash | 2d885b0cddd2 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /checkout |
Disallow | /api |
Disallow | /?ecid |
Disallow | /legal |
Disallow | /inStockRefinement |
Disallow | /dwrExclusiveRefinement |
Disallow | /size |
Disallow | */Product-Variation |
Disallow | */Product-ShowQuickView |
Disallow | */prefn1 |
Disallow | */crefn1 |
Disallow | */?showMap |
Disallow | */ARI-Show? |
Disallow | */orderconfirmation |
Disallow | */Search-UpdateGrid?cgid |
Disallow | */all-parts?fitsOnModel |
Disallow | */?fitsOnModel |
Disallow | /*pmin* |
Disallow | /*pmax* |
Disallow | /*prefn1* |
Disallow | /*prefn2* |
Disallow | /*prefn3* |
Disallow | /*prefn4* |
Disallow | /*prefv1* |
Disallow | /*prefv2* |
Disallow | /*prefv3* |
Disallow | /*prefv4* |
Disallow | /*srule* |
Other Records
Field | Value |
---|---|
sitemap | https://www.mtdparts.com/sitemap_index.xml |