crocs.in
robots.txt
Robots Exclusion Standard data for crocs.in
Resource Scan
Scan Details
Site Domain | crocs.in |
Base Domain | crocs.in |
Scan Status | Ok |
Last Scan | 2025-09-16T04:28:21+00:00 |
Next Scan | 2025-10-16T04:28:21+00:00 |
Last Scan
Scanned | 2025-09-16T04:28:21+00:00 |
URL | https://crocs.in/robots.txt |
Redirect | https://www.crocs.in/robots.txt |
Redirect Domain | www.crocs.in |
Redirect Base | crocs.in |
Domain IPs | 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124 |
Redirect IPs | 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124 |
Response IP | 146.75.45.124 |
Found | Yes |
Hash | 4c504eba268ff1efa0375db15ab033e2d5cfc035e923c81df58d423ecf793e1a |
SimHash | 4924fe4cc196 |
Groups
*
Rule | Path |
---|---|
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /customer/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Disallow | /checkout/ |
Disallow | /onestepcheckout/ |
Disallow | /customer/ |
Disallow | /customer/account/ |
Disallow | /customer/account/sign-in/ |
Disallow | /catalogsearch/ |
Disallow | /catalog/product_compare/ |
Disallow | /catalog/category/view/ |
Disallow | /catalog/product/view/ |
Disallow | /*?dir* |
Disallow | /*?dir=desc |
Disallow | /*?dir=asc |
Disallow | /*?limit=all |
Disallow | /*?mode* |
Disallow | /app/ |
Disallow | /bin/ |
Disallow | /dev/ |
Disallow | /lib/ |
Disallow | /phpserver/ |
Disallow | /pub/ |
Disallow | /customer/account/sign-in/referer/ |
Disallow | /customer/account/forgotpassword/ |
Disallow | /customer/account/create/ |
Disallow | /*pr_rd_page%3D* |
Disallow | /*bayaband* |
Disallow | /*baya* |
googlebot
Rule | Path |
---|---|
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /customer/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Disallow | /checkout/ |
Disallow | /onestepcheckout/ |
Disallow | /customer/ |
Disallow | /customer/account/ |
Disallow | /customer/account/sign-in/ |
Disallow | /catalogsearch/ |
Disallow | /catalog/product_compare/ |
Disallow | /catalog/category/view/ |
Disallow | /catalog/product/view/ |
Disallow | /*?dir* |
Disallow | /*?dir=desc |
Disallow | /*?dir=asc |
Disallow | /*?limit=all |
Disallow | /*?mode* |
Disallow | /app/ |
Disallow | /bin/ |
Disallow | /dev/ |
Disallow | /lib/ |
Disallow | /phpserver/ |
Disallow | /pub/ |
Disallow | /customer/account/sign-in/referer/ |
Disallow | /customer/account/forgotpassword/ |
Disallow | /customer/account/create/ |
Disallow | /*pr_rd_page%3D* |
Disallow | /*bayaband* |
Disallow | /*baya* |
Other Records
Field | Value |
---|---|
sitemap | https://www.crocs.in/media/sitemap/sitemap_category_category.xml |
sitemap | https://www.crocs.in/media/sitemap/sitemap_product_product.xml |
sitemap | https://www.crocs.in/media/sitemap/sitemap_cms_cms.xml |