shop.aesop.com
robots.txt
Robots Exclusion Standard data for shop.aesop.com
Resource Scan
Scan Details
| Site Domain | shop.aesop.com |
| Base Domain | aesop.com |
| Scan Status | Ok |
| Last Scan | 2026-02-13T04:11:20+00:00 |
| Next Scan | 2026-03-15T04:11:20+00:00 |
Last Scan
| Scanned | 2026-02-13T04:11:20+00:00 |
| URL | https://shop.aesop.com/robots.txt |
| Domain IPs | 23.203.74.96, 2600:1413:5000:a8d::6c6, 2600:1413:5000:a8e::6c6 |
| Response IP | 23.203.74.96 |
| Found | Yes |
| Hash | bbea58c38de468a0bd16a0f2aee603a187b11836b94eab485e527186213cafa7 |
| SimHash | 6c13900e7ebb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /storeswitcher |
| Disallow | /*/storeswitcher |
| Disallow | /index.php |
| Disallow | /*/index.php |
| Disallow | /*/wishlist |
| Disallow | /catalog/product_compare |
| Disallow | /*/catalog/product_compare |
| Disallow | /my-account |
| Disallow | /my-account/** |
| Disallow | /checkout |
| Disallow | /checkout/** |
| Disallow | /cart |
| Disallow | /login/checkout |
| Disallow | /reset-password |
| Disallow | /unsubscribe |
| Disallow | /newsletter-subscription |
| Disallow | /register/checkout |
| Disallow | /login |
| Disallow | /login/** |
| Disallow | /register |
| Disallow | /payment-details |
| Disallow | /set-default-payment-details |
| Disallow | /remove-payment-method |
| Disallow | /remove-address/ |
| Disallow | /set-default-address/ |
| Disallow | /select-suggested-address |
| Disallow | /edit-address/** |
| Disallow | /store-finder |
| Disallow | /api/* |
| Disallow | /api/v1/** |
| Disallow | /*/my-account |
| Disallow | /*/my-account/** |
| Disallow | /*/checkout |
| Disallow | /*/checkout/** |
| Disallow | /*/cart |
| Disallow | /*/login/checkout |
| Disallow | /*/reset-password |
| Disallow | /*/unsubscribe |
| Disallow | /*/newsletter-subscription |
| Disallow | /*/register/checkout |
| Disallow | /*/login |
| Disallow | /*/login/** |
| Disallow | /*/register |
| Disallow | /*/payment-details |
| Disallow | /*/set-default-payment-details |
| Disallow | /*/remove-payment-method |
| Disallow | /*/remove-address/ |
| Disallow | /*/set-default-address/ |
| Disallow | /*/select-suggested-address |
| Disallow | /*/edit-address/** |
| Disallow | /*/store-finder |
| Disallow | /*/api/* |
| Disallow | /*/cabinet |
| Disallow | /p/**/?variant=* |
| Disallow | *?SID=U |
| Disallow | *?byrange |
| Disallow | *?byconcern |
| Disallow | *?shopMenu=open |
| Disallow | *?readMenu=open |
| Disallow | *?searchMenu=open |
| Disallow | *?visitMenu=open |
| Disallow | *?siteName |
| Disallow | *?triggerChat=true |
| Disallow | *?contentful=true |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aesop.com/us/sitemap.xml |
| sitemap | https://www.aesop.com/au/sitemap.xml |
| sitemap | https://www.aesop.com/nz/sitemap.xml |
| sitemap | https://www.aesop.com/sg/sitemap.xml |
| sitemap | https://shop.aesop.com/uk/sitemap.xml |
| sitemap | https://www.aesop.com/jp/sitemap.xml |
| sitemap | https://shop.aesop.com/kr/sitemap.xml |
| sitemap | https://shop.aesop.com/it/sitemap.xml |
| sitemap | https://shop.aesop.com/dk/sitemap.xml |
| sitemap | https://shop.aesop.com/se/sitemap.xml |
| sitemap | https://shop.aesop.com/no/sitemap.xml |
| sitemap | https://shop.aesop.com/fr/fr/sitemap.xml |
| sitemap | https://shop.aesop.com/fr/en/sitemap.xml |
| sitemap | https://shop.aesop.com/fr/es/sitemap.xml |
| sitemap | https://www.aesop.com/ca/en/sitemap.xml |
| sitemap | https://www.aesop.com/ca/fr/sitemap.xml |
| sitemap | https://www.aesop.com/hk/en/sitemap.xml |
| sitemap | https://www.aesop.com/hk/zh_hant/sitemap.xml |
| sitemap | https://www.aesop.com/tw/sitemap.xml |
| sitemap | https://shop.aesop.com/de/de/sitemap.xml |
| sitemap | https://shop.aesop.com/de/en/sitemap.xml |
| sitemap | https://shop.aesop.com/ch/de/sitemap.xml |
| sitemap | https://shop.aesop.com/ch/fr/sitemap.xml |
| sitemap | https://shop.aesop.com/ch/en/sitemap.xml |
Comments