dollarshaveclub.com
robots.txt
Robots Exclusion Standard data for dollarshaveclub.com
Resource Scan
Scan Details
| Site Domain | dollarshaveclub.com |
| Base Domain | dollarshaveclub.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-08-14T01:59:58+00:00 |
| Next Scan | 2024-11-12T01:59:58+00:00 |
Last Successful Scan
| Scanned | 2024-01-11T01:51:59+00:00 |
| URL | https://dollarshaveclub.com/robots.txt |
| Redirect | https://www.dollarshaveclub.com/robots.txt |
| Redirect Domain | www.dollarshaveclub.com |
| Redirect Base | dollarshaveclub.com |
| Domain IPs | 151.101.1.9, 151.101.129.9, 151.101.193.9, 151.101.65.9 |
| Redirect IPs | 151.101.1.9, 151.101.129.9, 151.101.193.9, 151.101.65.9 |
| Response IP | 199.232.45.9 |
| Found | Yes |
| Hash | 09b105505f57496847c383e3bb0d5ebaac3eb241daee3b815bb1f70513ef78c4 |
| SimHash | 642d5f4bc2fa |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /your-account |
| Disallow | /account |
| Disallow | /your-box |
| Disallow | /api |
| Disallow | /coupon |
| Disallow | /cancel-subscription |
| Disallow | /join-the-team |
| Disallow | /page |
| Disallow | /our-products/fresh-blades |
| Disallow | /our-products/matte-black-handle |
| Disallow | /our-products/matte-navy-handle |
| Disallow | /our-products/sporty-orange-handle |
| Disallow | /our-products/sporty-white-handle |
| Disallow | /storefront |
| Disallow | /manage |
| Disallow | /v/ |
| Disallow | /join |
| Disallow | /lp/join |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dollarshaveclub.com/sitemap.xml |