| Disallow |
/*admin/ |
Blocks access to administrative areas to protect backend operations |
| Disallow |
/*cgi-bin/ |
Blocks access to the script directory to prevent execution of scripts |
| Disallow |
/*cart/ |
Blocks access to user carts to prevent unnecessary crawler traffic |
| Disallow |
/*checkout/ |
Prevents checkout pages from being indexed to protect user data |
| Disallow |
/*my-account/ |
Blocks access to user account information for privacy |
| Disallow |
/*wishlist/ |
Disallows indexing of user wishlist pages |
| Disallow |
/*lib/ |
Blocks library directories that contain site code |
| Disallow |
/*.php$ |
Prevents direct access to PHP files, which might expose sensitive information |
| Disallow |
/*pkginfo/ |
Blocks indexing of package information directories |
| Disallow |
/*report/ |
Disallows access to reporting tools and directories |
| Disallow |
/*var/ |
Prevents search engines from accessing variable directories |
| Disallow |
/*customer/ |
Disallows access to customer-specific areas to protect personal data |
| Disallow |
/*sendfriend/ |
Prevents indexing of referral links and pages |
| Disallow |
/*review/ |
Blocks review directories to prevent duplicate content issues |
| Disallow |
/*SID%3D |
Blocks URLs containing session IDs to prevent tracking of user sessions |
| Disallow |
/*?SID= |
Blocks URLs that begin with session IDs, redundant with previous rule |
| Disallow |
/*?PHPSESSID= |
Blocks PHP session IDs to enhance security and privacy |
| Disallow |
/*?q= |
Disallows indexing of search results to prevent duplicate content |
| Disallow |
/*?amnoroute= |
Blocks non-routable URLs, typically errors or misconfigurations |
| Disallow |
/*?addToCart= |
Prevents indexing of add-to-cart actions |
| Disallow |
/*?price= |
Blocks indexing of URLs with price parameters to prevent duplicates |
| Disallow |
/*%26price%3D |
Blocks incorrect usage of price parameters in URLs |
| Disallow |
/*___from_store%3D |
Disallows store switch parameters, not relevant for search engines |
| Disallow |
/*?addToWish |
Prevents indexing of add-to-wishlist actions |
| Disallow |
/*?product_list_order |
Blocks specific product list ordering parameters, possibly a typo |
| Disallow |
/*?nxt_ |
Blocks parameters starting with "nxt_", used for custom tracking or navigation |
| Disallow |
/*?color |
Blocks indexing of URLs with color parameters to prevent duplicates |
| Disallow |
/*onestepcheckout/ |
Blocks one-step checkout processes to protect transaction details |
| Disallow |
/*catalogsearch/ |
Blocks catalog search pages to prevent indexing of search queries |
| Disallow |
/*catalog/product_compare/ |
Prevents indexing of product comparison functionality |
| Disallow |
/*catalog/category/view/ |
Disallows specific category views which are not SEO-friendly |
| Disallow |
/*catalog/product/view/ |
Blocks direct product views which should not be accessed directly by crawlers |
| Disallow |
/*amasty_xsearch/ |
Blocks access to the Amasty Xsearch extension's pages |
| Disallow |
/*?dir* |
Blocks all sorting directions to prevent multiple index entries |
| Disallow |
/*?dir=desc |
Specifically blocks descending sort order |
| Disallow |
/*?dir=asc |
Specifically blocks ascending sort order |
| Disallow |
/*?limit=all |
Blocks URLs that show all products on one page, which can be heavy for indexing |
| Disallow |
/*?mode* |
Blocks mode parameters which adjust the view of listed products |
| Disallow |
/*?cat= |
Prevents indexing of specific category parameters |
| Disallow |
/*?limit= |
Blocks limit parameters that control pagination, possibly a typo |
| Disallow |
/*?oct8ne= |
Blocks custom parameters related to specific functionalities |
| Disallow |
/*?manufacturer= |
Blocks manufacturer filters to prevent duplicate content |
| Disallow |
/*?bodega= |
Prevents indexing of bodega-specific filters |
| Disallow |
/*?_q= |
Disallows query parameters that could expose search functionalities |
| Disallow |
/*?oct8neOpen= |
Blocks custom parameters used for specific tracking or functionalities |
| Disallow |
/*?product_list_dir= |
Disallows sorting directions for product lists which can create duplicates |
| Disallow |
/app/ |
Blocks access to application files, which can contain sensitive code |
| Disallow |
/bin/ |
Disallows access to binary files, typically executables or scripts |
| Disallow |
/dev/ |
Blocks access to development environment files and directories |
| Disallow |
/phpserver/ |
Prevents access to PHP server directories |
Comments