Log In Sign Up

gorillabrakes.com
robots.txt

Robots Exclusion Standard data for gorillabrakes.com

Resource Scan

Scan Details

Site Domain gorillabrakes.com
Base Domain gorillabrakes.com
Scan Status Ok
Last Scan2026-03-31T07:41:21+00:00
Next Scan 2026-04-07T07:41:21+00:00

Last Scan

Scanned2026-03-31T07:41:21+00:00
URL https://gorillabrakes.com/robots.txt
Domain IPs 23.227.38.65
Response IP 23.227.38.65
Found Yes
Hash 0d84872b1dc2679be18ba4035da096b0dbf9bcf31405bd08fa66a742e3705b9f
SimHash 60910852c485

Groups

*

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /checkout
Disallow /checkouts/
Disallow /orders
Disallow /account
Disallow /76598313279/checkouts
Disallow /76598313279/orders
Disallow /services/
Disallow */collections/*sort_by*
Disallow */collections/*%2B*
Disallow */collections/*%2B*
Disallow */collections/*%2B*
Disallow */collections/*filter*%3D*
Disallow */blogs/*%2B*
Disallow */blogs/*%2B*
Disallow */blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /*?*ls=*
Disallow /*ls%3D*
Disallow /*ls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /recommendations/products
Disallow */recommendations/products

adsbot-google

Rule Path
Disallow /checkout
Disallow /checkouts/
Disallow /carts
Disallow /orders
Disallow /76598313279/checkouts
Disallow /76598313279/orders
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /cdn/wpm/*.js

nutch

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /carts
Disallow /checkout
Disallow /checkouts/
Disallow /orders
Disallow /account
Disallow /76598313279/checkouts
Disallow /76598313279/orders
Disallow */collections/*sort_by*
Disallow */collections/*%2B*
Disallow */collections/*%2B*
Disallow */collections/*%2B*
Disallow */collections/*filter*%3D*
Disallow */blogs/*%2B*
Disallow */blogs/*%2B*
Disallow */blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /*?*ls=*
Disallow /*ls%3D*
Disallow /*ls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

bingbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://gorillabrakes.com/sitemap.xml
sitemap https://gorillabrakes.com/sitemap.xml
Back to top

Comments

  • robots.txt for Gorilla Brakes - Shopify Store
  • Block Shopify OAuth URLs (fixes 5xx errors)
  • Prevent duplicate or filtered collection pages
  • Prevent duplicate or filtered blog URLs
  • Block preview and tracking parameters
  • Allow policy pages for trust and Google Merchant Center compliance
  • (e.g. /policies/refund-policy, /policies/shipping-policy)
  • These pages help with Shopping Ads, SEO, and customer trust.
  • Block search (optional — uncheck if you want internal search pages indexed)
  • Block Shopify internal and analytics resources
  • AdsBot-specific rules
  • Completely block Nutch
  • Ahrefs & similar bots - throttle crawl
  • Other specific crawlers
  • --- Custom Rules to Allow AI Crawlers ---
Back to top