madewell.com
robots.txt
Robots Exclusion Standard data for madewell.com
Resource Scan
Scan Details
| Site Domain | madewell.com |
| Base Domain | madewell.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-17T06:24:07+00:00 |
| Next Scan | 2024-12-16T06:24:07+00:00 |
Last Successful Scan
| Scanned | 2023-10-25T14:04:37+00:00 |
| URL | https://madewell.com/robots.txt |
| Redirect | https://www.madewell.com/robots.txt |
| Redirect Domain | www.madewell.com |
| Redirect Base | madewell.com |
| Domain IPs | 184.86.218.163 |
| Redirect IPs | 23.207.182.138 |
| Response IP | 23.207.182.138 |
| Found | Yes |
| Hash | e48b74e519f4628d697d0de5b4f51ef8d01ce4fc5d463006e7be752d4aa14d4a |
| SimHash | a06b5887c6b7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | Cart-Show |
| Disallow | Account-Show |
| Disallow | COBilling-Start |
| Disallow | COShipping-Start |
| Disallow | Account-Show |
| Disallow | Account-StartRegister |
| Disallow | Wishlist-Show |
| Disallow | Search-Show |
| Disallow | Wishlist-Show |
| Disallow | terms-of-use.html |
| Disallow | privacy-policy.html |
| Disallow | social-responsibility.html |
| Disallow | gift-card-promo-how-to.html |
| Disallow | Account-EditProfile |
| Disallow | Account-PasswordReset |
| Disallow | Account-SetNewPassword |
| Disallow | Account-SetNewPasswordConfirm |
| Disallow | Address-List |
| Disallow | COCustomer-Start |
| Disallow | COCustomer-Start |
| Disallow | Home-ErrorNotFound |
| Disallow | Login-OrderStatus |
| Disallow | Order-History |
| Disallow | PaymentInstruments-List |
| Disallow | /?q=* |
| Disallow | /*pmax%3D* |
| Disallow | /*pmin%3D* |
| Disallow | /*cgid%3D* |
| Disallow | /*sz%3D* |
| Disallow | /*size%3D* |
| Disallow | /*%7C* |
| Disallow | /*q%3D |
| Disallow | /search?q=* |
| Disallow | /*gridtype%3D |
| Disallow | /on/demandware.store/Sites-madewellUS-Site/default/Product-Variation |
| Disallow | /on/demandware.store/Sites-madewellUS-Site/en_US/Product-Multisell |
| Disallow | /on/demandware.store/Sites-madewellUS-Site/default/Bazaarvoice-SubmissionContainer |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.madewell.com/sitemap_index.xml |