rzcrewgarage.com
robots.txt

Robots Exclusion Standard data for rzcrewgarage.com

Resource Scan

Scan Details

Site Domain rzcrewgarage.com
Base Domain rzcrewgarage.com
Scan Status Ok
Last Scan2025-11-21T15:02:51+00:00
Next Scan 2025-12-05T15:02:51+00:00

Last Scan

Scanned2025-11-21T15:02:51+00:00
URL https://rzcrewgarage.com/robots.txt
Domain IPs 23.227.38.65
Response IP 23.227.38.65
Found Yes
Hash e306f96ad6503e33633f6bae7241fd334e22a46033134db6e98c3b3d690c378d
SimHash f39c8952c4e4

Groups

adsbot-googledisallow: /checkouts/disallow: /checkoutdisallow: /cartsdisallow: /ordersdisallow: /23435009/checkoutsdisallow: /23435009/ordersdisallow: /*?*oseid=*disallow: /*preview_theme_id*disallow: /*preview_script_id*disallow: /cdn/wpm/*.jsdisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remoteuser-agent: nutchdisallow: /user-agent: ahrefsbotcrawl-delay: 10disallow: /a/downloads/-/*disallow: /admindisallow: /cartdisallow: /ordersdisallow: /checkouts/disallow: /checkoutdisallow: /23435009/checkoutsdisallow: /23435009/ordersdisallow: /cartsdisallow: /accountdisallow: /collections/*sort_by*disallow: /*/collections/*sort_by*disallow: /collections/*+*disallow: /collections/*%2b*disallow: /collections/*%2b*disallow: /*/collections/*+*disallow: /*/collections/*%2b*disallow: /*/collections/*%2b*disallow: */collections/*filter*&*filter*disallow: /blogs/*+*disallow: /blogs/*%2b*disallow: /blogs/*%2b*disallow: /*/blogs/*+*disallow: /*/blogs/*%2b*disallow: /*/blogs/*%2b*disallow: /*?*oseid=*disallow: /*preview_theme_id*disallow: /*preview_script_id*disallow: /policies/disallow: /*/policies/disallow: /*/*?*ls=*&ls=*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /searchdisallow: /apple-app-site-associationdisallow: /.well-known/shopify/monoraildisallow: /cdn/wpm/*.jsdisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotesitemap: https://rzcrewgarage.com/sitemap.xml
ahrefssiteauditcrawl-delay: 10disallow: /a/downloads/-/*disallow: /admindisallow: /cartdisallow: /ordersdisallow: /checkouts/disallow: /checkoutdisallow: /23435009/checkoutsdisallow: /23435009/ordersdisallow: /cartsdisallow: /accountdisallow: /collections/*sort_by*disallow: /*/collections/*sort_by*disallow: /collections/*+*disallow: /collections/*%2b*disallow: /collections/*%2b*disallow: /*/collections/*+*disallow: /*/collections/*%2b*disallow: /*/collections/*%2b*disallow: */collections/*filter*&*filter*disallow: /blogs/*+*disallow: /blogs/*%2b*disallow: /blogs/*%2b*disallow: /*/blogs/*+*disallow: /*/blogs/*%2b*disallow: /*/blogs/*%2b*disallow: /*?*oseid=*disallow: /*preview_theme_id*disallow: /*preview_script_id*disallow: /policies/disallow: /*/policies/disallow: /*/*?*ls=*&ls=*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /*/*?*ls%3d*%3fls%3d*disallow: /searchdisallow: /apple-app-site-associationdisallow: /.well-known/shopify/monoraildisallow: /cdn/wpm/*.jsdisallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotedisallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remotesitemap: https://rzcrewgarage.com/sitemap.xml
mj12botcrawl-delay: 10user-agent: pinterestcrawl-delay: 1
gptbot

Product Comment
mj12botcrawl-delay: 10user-agent: pinterestcrawl-delay: 1 --- Custom AI crawler access (added manually) ---
Rule Path
Allow /

google-extended

Rule Path
Allow /

claude-web

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

ccbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://rzcrewgarage.com/sitemap.xml
sitemap https://rzcrewgarage.com/sitemap.xml

Comments

  • we use Shopify as our ecommerce platform
  • These allow large language model crawlers to index your public catalog and pages.
  • --- Optional: additional sitemap declaration ---

Warnings

  • 1 invalid line.