renttherunway.com
robots.txt
Robots Exclusion Standard data for renttherunway.com
Resource Scan
Scan Details
| Site Domain | renttherunway.com |
| Base Domain | renttherunway.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-10T04:55:53+00:00 |
| Next Scan | 2024-05-24T04:55:53+00:00 |
Last Successful Scan
| Scanned | 2023-03-21T09:35:03+00:00 |
| URL | https://renttherunway.com/robots.txt |
| Redirect | https://www.renttherunway.com/robots.txt |
| Redirect Domain | www.renttherunway.com |
| Redirect Base | renttherunway.com |
| Domain IPs | 199.232.46.132 |
| Redirect IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
| Response IP | 199.232.46.132 |
| Found | Yes |
| Hash | 4b82db25a574fa210ca950bd431649465700b57d7116b4cc8fae7300369c1146 |
| SimHash | e9930247c415 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /archive/ |
| Disallow | /press/ |
| Disallow | /release/ |
| Disallow | /team/ |
| Disallow | /user/orders |
| Disallow | /user/credits |
| Disallow | /shares |
| Disallow | /user/profile |
| Disallow | /upgrades |
| Disallow | /order |
| Disallow | /account/whoami |
| Disallow | /shortlist/ |
| Disallow | /carousels/ |
| Disallow | /similar/ |
| Allow | /shortlist$ |
| Disallow | /*/holiday_party_dresses* |
| Disallow | /*/office_holiday_party_dresses* |
| Disallow | /*/holiday_black_tie_dresses* |
| Disallow | /*/holiday_cocktail_dresses* |
| Disallow | /juicy |
| Disallow | /glowingup |
| Disallow | /smalldoses |
| Disallow | /shade |
| Disallow | /who |
| Disallow | /lively |
| Disallow | /goaldigger |
| Disallow | /lovin |
| Disallow | /nordstrom |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.renttherunway.com/sitemaps/curations.xml |
| sitemap | https://www.renttherunway.com/sitemaps/designers.xml |
| sitemap | https://www.renttherunway.com/sitemaps/products.xml |
| sitemap | https://www.renttherunway.com/sitemaps/product-categories.xml |