libertylondon.com
robots.txt

Robots Exclusion Standard data for libertylondon.com

Resource Scan

Scan Details

Site Domain libertylondon.com
Base Domain libertylondon.com
Scan Status Ok
Last Scan2024-10-08T22:29:25+00:00
Next Scan 2024-11-07T22:29:25+00:00

Last Scan

Scanned2024-10-08T22:29:25+00:00
URL https://libertylondon.com/robots.txt
Redirect https://www.libertylondon.com/robots.txt
Redirect Domain www.libertylondon.com
Redirect Base libertylondon.com
Domain IPs 104.16.10.39, 104.16.11.39
Redirect IPs 104.17.19.24, 104.17.20.24
Response IP 104.17.20.24
Found Yes
Hash d11d30bb865fbf3fc1571fb0d5c03e09d1f4485fce167f3ac395e4b4869f936d
SimHash 79b888215faa

Groups

*

Rule Path
Disallow /on/demandware.store/Sites-liberty-Site/default/Account-StartRegister
Disallow /on/demandware.store/Sites-liberty-Site/default/Account-PasswordResetDialog
Disallow /on/demandware.store/Sites-liberty-Site/default/GiftCert-Purchase
Disallow /on/demandware.store/Sites-liberty-Site/default/GiftRegistry-Start
Disallow /on/demandware.store/Sites-liberty-Site/default/Page-Show
Disallow /on/demandware.store/Sites-liberty-Site/default/Wishlist-SetShippingAddress
Disallow /on/demandware.static/-/Sites-liberty-Library/default
Disallow /uk/corporate-social-responsibility.html
Disallow /us/corporate-social-responsibility.html
Disallow /uk/beauty-subscription-preview
Disallow /us/beauty-subscription-preview
Disallow /uk/beauty-subscription-registration
Disallow /us/beauty-subscription-registration
Disallow /uk/replacements/
Disallow /uk/ampliencecontenthubassets/brand-no-longer-online.html
Disallow /us/ampliencecontenthubassets/brand-no-longer-online.html
Disallow /us/miracle-balm-palette-i-2g-000821250.html
Disallow /uk/miracle-balm-palette-i-2g-000821250.html
Disallow /*/search
Allow */css/search.css
Allow */js/searchPartial.js
Allow */js/search.js
Disallow /*?pmax
Disallow /*%26pmin
Disallow /*?sz=150$
Disallow /*%26prefn
Disallow /*?prefn
Disallow /*%26prefv
Disallow /*?prefv
Disallow /*?q=
Disallow /*/Wishlist-Add
Disallow /*/Subscription-HandleWebhookCall
Disallow /*?start
Disallow /*?srule
Disallow /*?sz
Disallow /*?dwvar
Disallow /*?cgid
Disallow */uk/size-guide*
Disallow */us/size-guide*
Disallow /int/*
Disallow /*?algq
Disallow /uk/brands/a/aesop/*?*sz=
Allow /uk/brands/a/aesop/*?*sz=60
Disallow /uk/brands/a/aesop/*?*start=*
Allow /uk/brands/a/aesop/*?*start=60*
Allow /uk/brands/a/aesop/*?*start=120*
Allow /uk/brands/a/aesop/*?*start=180*
Allow /uk/brands/a/aesop/*?*start=240*
Allow /uk/brands/a/aesop/*?*start=300*
Allow /uk/brands/a/aesop/*?*start=360*

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.libertylondon.com/sitemap_index.xml