mtdparts.com
robots.txt

Robots Exclusion Standard data for mtdparts.com

Resource Scan

Scan Details

Site Domain mtdparts.com
Base Domain mtdparts.com
Scan Status Ok
Last Scan2024-11-16T05:25:55+00:00
Next Scan 2024-12-16T05:25:55+00:00

Last Scan

Scanned2024-11-16T05:25:55+00:00
URL https://mtdparts.com/robots.txt
Redirect https://www.mtdparts.com/robots.txt
Redirect Domain www.mtdparts.com
Redirect Base mtdparts.com
Domain IPs 23.215.7.16, 23.215.7.20, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:714
Redirect IPs 104.19.152.81, 104.19.153.81
Response IP 104.19.153.81
Found Yes
Hash 414ce7d7167d1df45fab5aa3fae9e8971334b10e31df796795d5884bd0821ad4
SimHash 2d885b0cddd2

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

*

Rule Path
Disallow /account
Disallow /checkout
Disallow /api
Disallow /?ecid
Disallow /legal
Disallow /inStockRefinement
Disallow /dwrExclusiveRefinement
Disallow /size
Disallow */Product-Variation
Disallow */Product-ShowQuickView
Disallow */prefn1
Disallow */crefn1
Disallow */?showMap
Disallow */ARI-Show?
Disallow */orderconfirmation
Disallow */Search-UpdateGrid?cgid
Disallow */all-parts?fitsOnModel
Disallow */?fitsOnModel
Disallow /*pmin*
Disallow /*pmax*
Disallow /*prefn1*
Disallow /*prefn2*
Disallow /*prefn3*
Disallow /*prefn4*
Disallow /*prefv1*
Disallow /*prefv2*
Disallow /*prefv3*
Disallow /*prefv4*
Disallow /*srule*

Other Records

Field Value
sitemap https://www.mtdparts.com/sitemap_index.xml