tw.aesop.com
robots.txt
Robots Exclusion Standard data for tw.aesop.com
Resource Scan
Scan Details
| Site Domain | tw.aesop.com |
| Base Domain | aesop.com |
| Scan Status | Ok |
| Last Scan | 2026-01-16T18:35:25+00:00 |
| Next Scan | 2026-02-15T18:35:25+00:00 |
Last Scan
| Scanned | 2026-01-16T18:35:25+00:00 |
| URL | https://tw.aesop.com/robots.txt |
| Domain IPs | 104.18.43.80, 172.64.144.176, 2606:4700:4405::6812:2b50, 2a06:98c1:3101::ac40:90b0 |
| Response IP | 104.18.43.80 |
| Found | Yes |
| Hash | 1b1afc8a0e805cfbfa4dc41d53d0fb8a90feec93f0010f20629a45a3345e5336 |
| SimHash | c013c946671f |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cart |
| Disallow | /account |
| Disallow | /register |
| Disallow | /on |
| Disallow | /shopping-bag |
| Disallow | /Address-List |
| Disallow | /checkout-start |
| Disallow | /Order-History |
| Disallow | /Search-Show |
| Disallow | /Wishlist-Show |
| Disallow | */cookie-policy.html |
| Disallow | */SendToFriend-Start |
| Disallow | */zh_TW/Wishlist-AddFavorite |
| Disallow | */Wishlist-Add |
| Disallow | */Reviews-SubmitFeedback |
| Disallow | /my-account |
| Disallow | /profile |
| Disallow | /orders |
| Disallow | /wallet |
| Disallow | /error |
| Disallow | /offline |
| Disallow | /orderconfirmation |
| Disallow | /revieworder |
| Disallow | /cart |
| Disallow | /privacy_policy.html |
| Disallow | /terms.html |
| Disallow | */Login-OAuthLogin |
| Disallow | /contact-us |
| Disallow | /register |
| Disallow | /wishlist |
| Disallow | */Account-PasswordResetDialog |
| Disallow | */Product-Variation |
| Disallow | */Order-Details |
| Disallow | */Search-Show |
| Disallow | */search |
| Disallow | /*pmin%3D* |
| Disallow | /*pmax%3D* |
| Disallow | /*prefn1%3D* |
| Disallow | /*prefn2%3D* |
| Disallow | /*prefv1%3D* |
| Disallow | /*prefv2%3D* |
| Disallow | /*crefn1%3D* |
| Disallow | /*crefn2%3D* |
| Disallow | /*crefv1%3D* |
| Disallow | /*crefv2%3D* |
| Disallow | /*subid%3D* |
| Disallow | /*start%3D* |
| Disallow | /*cgid%3D* |
| Disallow | /*sz%3D* |
| Disallow | /*format%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*linksrc%3D* |
| Disallow | /*variantID%3D* |
| Disallow | /*srule%3D* |
| Disallow | /*start%3D* |
| Disallow | /*ptype%3D* |
| Disallow | /*pcat%3D* |
| Disallow | /*categorycode%3D* |
| Disallow | /*dwcont%3D* |
| Disallow | /*prdcode* |
| Disallow | /*vname* |
| Disallow | /*csortd1* |
| Disallow | /*csortb1* |
| Disallow | /*dwvar* |
| Disallow | /send-to-friend* |
| Disallow | /order-inquiry* |
| Disallow | /my-account* |
| Disallow | /on/demandware.store/Sites-aesop-tw-ng-Site/default/Account-StartRegister |
| Disallow | /on/demandware.store/Sites-aesop-tw-ng-Site/default/Account-PasswordResetDialog |
| Disallow | /on/demandware.store/Sites-aesop-tw-ng-Site/default/GiftCert-Purchase |
| Disallow | /on/demandware.store/Sites-aesop-tw-ng-Site/default/GiftRegistry-Start |
| Disallow | /on/demandware.store/Sites-aesop-tw-ng-Site/default/Page-Show |
| Disallow | /on/demandware.store/Sites-aesop-tw-ng-Site/default/Wishlist-SetShippingAddress |
| Disallow | /on/demandware.static/-/Sites-aesop-tw-ng-Library/default |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tw.aesop.com/sitemap_0.xml |
Warnings
- `noindex` is not a known field.