mtdparts.ca
robots.txt

Robots Exclusion Standard data for mtdparts.ca

Resource Scan

Scan Details

Site Domain mtdparts.ca
Base Domain mtdparts.ca
Scan Status Ok
Last Scan2024-09-22T22:00:08+00:00
Next Scan 2024-10-22T22:00:08+00:00

Last Scan

Scanned2024-09-22T22:00:08+00:00
URL https://mtdparts.ca/robots.txt
Redirect https://www.mtdparts.ca/robots.txt
Redirect Domain www.mtdparts.ca
Redirect Base mtdparts.ca
Domain IPs 23.215.7.16, 23.215.7.20, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:714
Redirect IPs 104.19.212.71, 104.19.213.71
Response IP 104.19.213.71
Found Yes
Hash 098b6c9359723dab34e1811c3cd8a0c89c36ed3dcbc14dfdf22eb1a1471de7b7
SimHash 2d8d5804f5d3

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

*

Rule Path
Disallow /account
Disallow /checkout
Disallow /api
Disallow /?ecid
Disallow /legal
Disallow /inStockRefinement
Disallow /dwrExclusiveRefinement
Disallow /size
Disallow */Product-Variation
Disallow */Product-ShowQuickView
Disallow *prefn1
Disallow /?q
Disallow *?showMap
Disallow */Search-UpdateGrid?cgid
Disallow */?fitsOnModel
Disallow /*pmin*
Disallow /*pmax*
Disallow /*prefn1*
Disallow /*prefn2*
Disallow /*prefn3*
Disallow /*prefn4*
Disallow /*prefv1*
Disallow /*prefv2*
Disallow /*prefv3*
Disallow /*prefv4*
Disallow /*srule*

Other Records

Field Value
sitemap https://www.mtdparts.ca/sitemap_index.xml