instacart.ca
robots.txt
Robots Exclusion Standard data for instacart.ca
Resource Scan
Scan Details
| Site Domain | instacart.ca |
| Base Domain | instacart.ca |
| Scan Status | Ok |
| Last Scan | 2024-10-03T14:34:33+00:00 |
| Next Scan | 2024-10-17T14:34:33+00:00 |
Last Scan
| Scanned | 2024-10-03T14:34:33+00:00 |
| URL | https://instacart.ca/robots.txt |
| Redirect | https://www.instacart.ca:443/robots.txt |
| Redirect Domain | www.instacart.ca |
| Redirect Base | instacart.ca |
| Domain IPs | 13.35.210.20, 13.35.210.53, 13.35.210.85, 13.35.210.99 |
| Redirect IPs | 104.18.32.55, 172.64.155.201, 2606:4700:4400::6812:2037, 2606:4700:4400::ac40:9bc9 |
| Response IP | 172.64.155.201 |
| Found | Yes |
| Hash | 53e427ef036572edf1019bbaa4e47f46a6831dcbfa911e72822a0a16b1314661 |
| SimHash | f3f8d1179337 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /accounts/unlock |
| Disallow | /api/ |
| Disallow | /ex/ |
| Disallow | /orders/ |
| Disallow | /redeem_coupon_token |
| Disallow | /store/ |
| Disallow | /store/order_changes/ |
| Disallow | /store/*/browse_departments* |
| Disallow | /store/*/ng/l/* |
| Disallow | /store/referrals* |
| Disallow | /store/item* |
| Disallow | /store/pickup/status/* |
| Disallow | /store/*/buy_it_again* |
| Disallow | /store/*/l/* |
| Disallow | /widgets/* |
| Disallow | /client-side-redirect/* |
| Disallow | /track/* |
| Disallow | /affiliate-program* |
| Disallow | /family/invite/* |
| Disallow | /family/accept/* |
| Disallow | /rate/orders/* |
| Disallow | /store_manager_admin |
| Disallow | /rest/v8/product/542617319 |
| Disallow | /rest/v8/product/258211234 |
| Disallow | /rest/v8/product/345162378 |
| Disallow | /rest/v8/product/183142388 |
| Allow | /store/categories/* |
| Allow | /store/hub/* |
| Allow | /store/s?k=* |
| Allow | /store/list/* |
| Allow | /store/brands/* |
| Allow | /store/*/storefront |
| Allow | /store/*/s?k=* |
| Allow | /store/*/collections/* |
| Allow | /s?k=* |
| Allow | /store/*/departments* |
| Allow | /store/*/departments/*/aisles* |
| Allow | /store/*/flyer |
| Allow | /store/*/search_v3* |
| Allow | /store/recipes/* |
| Allow | /store/aldi/products/* |
| Allow | /store/costco/products/* |
| Allow | /store/kroger/products/* |
| Allow | /store/publix/products/* |
| Allow | /store/safeway/products/* |
| Allow | /store/sprouts/products/* |
| Allow | /store/walgreens/products/* |
Comments