tougherthantom.com
robots.txt

Groups

googlebot

adsbot-googledisallow: /checkouts/disallow: /checkoutdisallow: /cartsdisallow: /ordersdisallow: /44238045333/checkoutsdisallow: /44238045333/ordersdisallow: /*?*oseid=*disallow: /*preview_theme_id*disallow: /*preview_script_id*disallow: /cdn/wpm/*.jsdisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remoteuser-agent: nutchdisallow: /user-agent: ahrefsbotcrawl-delay: 10disallow: /a/downloads/-/*disallow: /admindisallow: /cartdisallow: /ordersdisallow: /checkouts/disallow: /checkoutdisallow: /44238045333/checkoutsdisallow: /44238045333/ordersdisallow: /cartsdisallow: /accountdisallow: /collections/*sort_by*disallow: /*/collections/*sort_by*disallow: /collections/*+*disallow: /collections/*%2b*disallow: /collections/*%2b*disallow: /*/collections/*+*disallow: /*/collections/*%2b*disallow: /*/collections/*%2b*disallow: */collections/*filter*&*filter*disallow: /blogs/*+*disallow: /blogs/*%2b*disallow: /blogs/*%2b*disallow: /*/blogs/*+*disallow: /*/blogs/*%2b*disallow: /*/blogs/*%2b*disallow: /*?*oseid=*disallow: /*preview_theme_id*disallow: /*preview_script_id*disallow: /policies/disallow: /*/policies/disallow: /*/*?*ls=*&ls=*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /searchdisallow: /apple-app-site-associationdisallow: /.well-known/shopify/monoraildisallow: /cdn/wpm/*.jsdisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotesitemap: https://tougherthantom.com/sitemap.xml
ahrefssiteauditcrawl-delay: 10disallow: /a/downloads/-/*disallow: /admindisallow: /cartdisallow: /ordersdisallow: /checkouts/disallow: /checkoutdisallow: /44238045333/checkoutsdisallow: /44238045333/ordersdisallow: /cartsdisallow: /accountdisallow: /collections/*sort_by*disallow: /*/collections/*sort_by*disallow: /collections/*+*disallow: /collections/*%2b*disallow: /collections/*%2b*disallow: /*/collections/*+*disallow: /*/collections/*%2b*disallow: /*/collections/*%2b*disallow: */collections/*filter*&*filter*disallow: /blogs/*+*disallow: /blogs/*%2b*disallow: /blogs/*%2b*disallow: /*/blogs/*+*disallow: /*/blogs/*%2b*disallow: /*/blogs/*%2b*disallow: /*?*oseid=*disallow: /*preview_theme_id*disallow: /*preview_script_id*disallow: /policies/disallow: /*/policies/disallow: /*/*?*ls=*&ls=*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /searchdisallow: /apple-app-site-associationdisallow: /.well-known/shopify/monoraildisallow: /cdn/wpm/*.jsdisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotesitemap: https://tougherthantom.com/sitemap.xml
mj12botcrawl-delay: 10user-agent: pinterestcrawl-delay: 1

No rules defined. All paths allowed.

Comments

• we use Shopify as our ecommerce platform# --- Custom Rule: Block /nogooglebot/ for Googlebot ---
• --- Continue with Shopify's default rules ---User-agent: *Disallow: /a/downloads/-/*Disallow: /adminDisallow: /cartDisallow: /ordersDisallow: /checkouts/Disallow: /checkoutDisallow: /44238045333/checkoutsDisallow: /44238045333/ordersDisallow: /cartsDisallow: /accountDisallow: /collections/*sort_by*Disallow: /*/collections/*sort_by*Disallow: /collections/*+*Disallow: /collections/*%2B*Disallow: /collections/*%2b*Disallow: /*/collections/*+*Disallow: /*/collections/*%2B*Disallow: /*/collections/*%2b*Disallow: */collections/*filter*&*filter*Disallow: /blogs/*+*Disallow: /blogs/*%2B*Disallow: /blogs/*%2b*Disallow: /*/blogs/*+*Disallow: /*/blogs/*%2B*Disallow: /*/blogs/*%2b*Disallow: /*?*oseid=*Disallow: /*preview_theme_id*Disallow: /*preview_script_id*Disallow: /policies/Disallow: /*/policies/Disallow: /*/*?*ls=*&ls=*Disallow: /*/*?*ls%3D*%3Fls%3D*Disallow: /*/*?*ls%3d*%3fls%3d*Disallow: /searchDisallow: /apple-app-site-associationDisallow: /.well-known/shopify/monorailDisallow: /cdn/wpm/*.jsDisallow: /recommendations/productsDisallow: /*/recommendations/productsDisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remoteDisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remoteDisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remoteDisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remoteSitemap: https://tougherthantom.com/sitemap.xml