Log In Sign Up

instacart.com
robots.txt

Robots Exclusion Standard data for instacart.com

Resource Scan

Scan Details

Site Domain instacart.com
Base Domain instacart.com
Scan Status Ok
Last Scan2025-03-12T21:14:49+00:00
Next Scan 2025-03-26T21:14:49+00:00

Last Scan

Scanned2025-03-12T21:14:49+00:00
URL https://instacart.com/robots.txt
Redirect https://www.instacart.com/robots.txt
Redirect Domain www.instacart.com
Redirect Base instacart.com
Domain IPs 3.170.229.103, 3.170.229.120, 3.170.229.8, 3.170.229.94
Redirect IPs 104.18.37.67, 172.64.150.189
Response IP 104.18.37.67
Found Yes
Hash 5670eeaa781108c96d3474bc34f57d3151af1f2ef403528a67b4342fd93c376d
SimHash 35bef31157f6

Groups

googlebot

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

googlebot-image

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

googlebot-mobile

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

storebot-google

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

adsbot-google-mobile

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

adsbot-google

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

bingbot

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=%C3%82

slurp

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

duckduckgo

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

oai-searchbot

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

perplexitybot

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

applebotâ

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

linkedinbot

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

twitterbot

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

facebookexternalhit

Rule Path
Disallow /assets

facebot

Rule Path
Disallow /assets

slackbot-linkexpanding

Rule Path
Allow /
Disallow /accounts/unlock
Disallow /api/
Disallow /ex/
Disallow /orders/
Disallow /store/orders/
Disallow /redeem_coupon_token
Disallow /store/order_changes/
Disallow /store/*/browse_departments*
Disallow /store/*/ng/l/*
Disallow /store/referrals*
Disallow /store/item*
Disallow /store/pickup/status/*
Disallow /store/*/buy_it_again*
Disallow /store/*/l/*
Disallow /widgets/*
Disallow /client-side-redirect/*
Disallow /track/*
Disallow /affiliate-program*
Disallow /family/invite/*
Disallow /family/accept/*
Disallow /rate/orders/*
Disallow /store_manager_admin
Disallow /rest/v8/
Disallow /login?next=
Disallow /*?*interaction_id=
Disallow /*?*item_detail_product_id=
Disallow /store/*/collections/*?*sisid=
Disallow /store/*/*?*xrs_id=

chatgpt-user

Rule Path
Allow /store/partner_recipes

twitterbot

Rule Path
Allow /store/list/*

*

Rule Path
Disallow /
Back to top

Comments

  • Any bot scraping or crawling this site must abide by
  • Instacart's Terms of Service https://www.instacart.com/terms
  • Last Updated 3-10-2025
  • Rules for Google search
  • Rules for Bing Search and powered by Bing search
  • Rules for Yahoo! Search
  • Rules for DuckDuckGo Search
  • Rules for Additional Search Engines
  • Rules for Social Sharing and Link Previews
  • Additional Rules from legacy file
  • All other scrapers compliance directive
  • If you're not a bot, we're hiring: https://instacart.careers/current-openings/
Back to top