Log In Sign Up

rituals.com
robots.txt

Robots Exclusion Standard data for rituals.com

Resource Scan

Scan Details

Site Domain rituals.com
Base Domain rituals.com
Scan Status Ok
Last Scan2025-03-25T17:21:57+00:00
Next Scan 2025-04-08T17:21:57+00:00

Last Scan

Scanned2025-03-25T17:21:57+00:00
URL https://rituals.com/robots.txt
Redirect https://www.rituals.com/robots.txt
Redirect Domain www.rituals.com
Redirect Base rituals.com
Domain IPs 104.17.155.187, 104.17.156.187
Redirect IPs 104.17.155.187, 104.17.156.187
Response IP 104.17.155.187
Found Yes
Hash 85c4757f738362f33116000e7fe50e0c99dc7e2fb38842be1d9b6ed4eac54c8a
SimHash 325828a3c0d5

Groups

*

Rule Path Comment
Disallow */fra- -
Disallow */eng- -
Disallow */deu- -
Disallow */account -
Disallow */account/* -
Disallow *rituals-account -
Disallow /account-edit-profile -
Disallow /address-list -
Disallow /order-* -
Disallow /cart -
Allow *css -
Allow *js -
Allow *jpg -
Allow *svg -
Allow *png -
Allow *gif -
Allow *woff NB this filetype is not currently in use, added for forward compatibility.
Allow *ttf -
Disallow /corporate-gifting* -
Allow /corporate-gifting*/home -
Disallow /hospitality-leisure* -
Allow /hospitality-leisure*/home -
Disallow /corporategifting* -
Disallow /corporategifting/eng-at/home -
Disallow /corporategifting/deu-at/home -
Disallow /corporategifting/eng-be/home -
Disallow /corporategifting/fra-be/home -
Disallow /corporategifting/eng-bg/home -
Disallow /corporategifting/eng-cy/home -
Disallow /corporategifting/eng-de/home -
Disallow /corporategifting/eng-dk/home -
Disallow /corporategifting/eng-ee/home -
Disallow /corporategifting/eng-es/home -
Disallow /corporategifting/eng-fi/home -
Disallow /corporategifting/eng-fr/home -
Disallow /corporategifting/eng-gr/home -
Disallow /corporategifting/eng-hk/home -
Disallow /corporategifting/eng-hr/home -
Disallow /corporategifting/eng-hu/home -
Disallow /corporategifting/eng-ie/home -
Disallow /corporategifting/eng-it/home -
Disallow /corporategifting/eng-lt/home -
Disallow /corporategifting/fra-lu/home -
Disallow /corporategifting/eng-lv/home -
Disallow /corporategifting/eng-no/home -
Disallow /corporategifting/eng-pl/home -
Disallow /corporategifting/eng-pt/home -
Disallow /corporategifting/eng-ro/home -
Disallow /corporategifting/eng-se/home -
Disallow /corporategifting/eng-si/home -
Allow /corporategifting*/home -
Disallow /personalised-gifts* -
Allow /personalised-gifts*/home -
Disallow */demandware.static/ Irrelevant urls that are either 410 or 500s. NB the resources are locale folder specific, therefore the non-specific paths.
Disallow */demandware.store/ Internal API urls that are either 410 or 500s or empty pages. NB the resources are locale folder specific, therefore the non-specific paths.
Allow */demandware.static/*jpg -
Allow */demandware.static/*svg -
Allow */demandware.static/*png -
Allow */demandware.static/*css -
Allow */demandware.static/*js -
Allow */demandware.static/*gif -
Allow */demandware.static/*woff NB this filetype is not currently in use, added for forward compatibility.
Allow */demandware.static/*ttf -
Allow /fra-*/*.html Allow all pages ending in .html for FRA urls, this will allow products, collection, magazine and some other content pages to be crawled.
Disallow /fra-*/collection*.html Exclude the collection pages
Disallow /fra-*/mag-* Exclude the magazine pages
Disallow /fra-*/faq* Exclude the faq pages.
Allow /eng-*/*.html Allow all pages ending in .html for ENG urls, this will allow products, collection, magazine and some other content pages to be crawled.
Disallow /eng-*/collection*.html Exclude the collection pages
Disallow /eng-*/mag-* Exclude the magazine pages
Disallow /eng-*/faq* Exclude the faq pages.
Allow /deu-*/*.html Allow all pages ending in .html for ENG urls, this will allow products, collection, magazine and some other content pages to be crawled.
Disallow /deu-*/collection*.html Exclude the collection pages
Disallow /deu-*/mag-* Exclude the magazine pages
Disallow /deu-*/faq* Exclude the faq pages.
Allow /fra-*/notfound -
Allow /eng-*/notfound -
Allow /deu-*/notfound -
Disallow /*?sz=* -
Disallow /*%26sz%3D* -
Disallow /*?switchpipeline=* -
Disallow /*%26switchpipeline%3D* -
Disallow /*?StoreID=* -
Disallow /*%26StoreID%3D* -
Disallow /*?original=* -
Disallow /*%26original%3D* -
Disallow /*?locale=* -
Disallow /*%26locale%3D* -
Disallow /*?lang=* -
Disallow /*%26lang%3D* -
Disallow /*?id=* -
Disallow /*%26id%3D* -
Disallow /*?format=* -
Disallow /*%26format%3D* -
Disallow /*?fdid=* -
Disallow /*%26fdid%3D* -
Disallow /*?dwcont=* -
Disallow /*%26dwcont%3D* -
Disallow /*?country=* -
Disallow /*%26country%3D* -
Disallow /*?category=* -
Disallow /*%26category%3D* -
Disallow /*?cgid=* -
Disallow /*%26cgid%3D* -
Disallow /*?self=* -
Disallow /*%26self%3D* -
Disallow /*?cid=* -
Disallow /*%26cid%3D* -
Disallow /*?pid=* -
Disallow /*%26pid%3D* -
Disallow /*?dwvar_*m_size=* -
Disallow /*%26dwvar_*m_size%3D* -
Disallow /*?q=* -
Disallow /*%26q%3D* -
Disallow /*?searchTerm=* -
Disallow /*%26searchTerm%3D* -
Disallow */search -
Disallow */search/* -
Disallow */checkout* -
Allow */jobs -

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow */advent*/home
Disallow /advent/*
Allow */advent*/the-rituals-of-advent*
Allow /advent/*/home
Allow /advent/*/the-ritual-of-advent-2d-ecom-2022-1114275.html
Allow /advent/*/the-ritual-of-advent-3d-ecom-2022-1114272.html
Allow /advent/*/the-ritual-of-advent-premium-2022-1114276.html
Allow /advent/*/the-ritual-of-advent-3d-2022-usa-1114273.html
Allow /advent/*/the-ritual-of-advent-3d-2022-hk-1115230.html
Disallow /nl-nl/cadeaus/cadeaupakketten/adventskalender
Disallow /en-hk/gifts/gift-sets/advent-calendar
Disallow /zh-hk/%E7%A6%AE%E5%93%81/%E7%A6%AE%E5%93%81%E5%A5%97%E8%A3%9D/advent-calendar-%E8%81%96%E8%AA%95%E5%80%92%E6%95%B8%E6%9C%88%E6%9B%86
Disallow /pt-pt/presentes/coffrets/calendario-do-advento
Disallow /es-es/regalos/cofres-de-regalo/calendario-de-adviento
Disallow /de-ch/geschenke/geschenksets/adventskalender
Disallow /de-de/geschenke/geschenksets/adventskalender
Disallow /fr-ch/cadeaux/coffrets-cadeaux/calendrier-de-l%E2%80%99avent
Disallow /no-no/gaver/gavesett/adventskalender
Disallow /da-dk/gaver/gaves%C3%A6t/gavekalender
Disallow /fi-fi/lahjat/lahjapakkaukset/joulukalenteri
Disallow /sv-se/gavor/gavoset/adventskalender
Disallow /en-nl/gifts/gift-sets/advent-calendar
Disallow /fr-fr/cadeaux/coffrets-cadeaux/calendrier-de-lavent
Disallow /hu-hu/ajandek/ajandekszettek/adventi-naptar
Disallow /ro-ro/cadouri/seturi-cadou/calendar-de-advent
Disallow /it-it/regali/confezioni-regalo/calendario-dellavvento
Disallow /pl-pl/prezenty/zestawy-podarunkowe/kalendarz-adwentowy
Disallow /el-gr/%CE%B4%CF%8E%CF%81%CE%B1/%CF%83%CE%B5%CF%84-%CE%B4%CF%8E%CF%81%CE%BF%CF%85/%CE%B7%CE%BC%CE%B5%CF%81%CE%BF%CE%BB%CF%8C%CE%B3%CE%B9%CE%BF-%CE%B1%CE%BD%CF%84%CE%AF%CF%83%CF%84%CF%81%CE%BF%CF%86%CE%B7%CF%82-%CE%BC%CE%AD%CF%84%CF%81%CE%B7%CF%83%CE%B7%CF%82-%CF%87%CF%81%CE%B9%CF%83%CF%84%CE%BF%CF%85%CE%B3%CE%AD%CE%BD%CE%BD%CF%89%CE%BD
Disallow /lt-lt/dovanos/dovan%C5%B3-rinkiniai/advento-kalendorius
Disallow /lv-lv/d%C4%81vanas/d%C4%81vanu-komplekti/adventes-kalend%C4%81rs
Disallow /hr-hr/darivanje/poklon-kompleti/adventski-kalendar
Disallow /et-ee/kingitused/kinkekomplektid/advendikalender
Disallow /bg-bg/%D0%BF%D0%BE%D0%B4%D0%B0%D1%80%D1%8A%D1%86%D0%B8/%D0%BF%D0%BE%D0%B4%D0%B0%D1%80%D1%8A%D1%87%D0%BD%D0%B8-%D0%BA%D0%BE%D0%BC%D0%BF%D0%BB%D0%B5%D0%BA%D1%82%D0%B8/%D0%B0%D0%B4%D0%B2%D0%B5%D0%BD%D1%82%D0%B5%D0%BD-%D0%BA%D0%B0%D0%BB%D0%B5%D0%BD%D0%B4%D0%B0%D1%80
Disallow /sl-si/darila/darilni-seti/adventni-koledar
Disallow /nl-be/cadeaus/cadeaupakketten/adventskalender
Disallow /en-us/gifts/gift-sets/advent-calendar
Disallow /en-gb/gifts/gift-sets/advent-calendar
Disallow /en-nl/gifts/gift-sets/advent-calendar
Disallow */advent-2022-fastlane-blocks.html
Disallow /gifting/*
Allow /gifting/*/home
Allow /gifting/*/the-ritual-of*
Allow /gifting/*/amsterdam-collection*
Allow /gifting/*/private-collection-set*
Allow /gifting/*/edp-gift-set*
Allow /gifting/*/good-fortune*
Allow /gifting/*/love-gift*
Allow /gifting/*/happiness-gift*
Allow /gifting/*/homme*
Disallow /greenfriday/*
Allow /greenfriday/*/green-friday*
Allow /greenfriday/*/home
Disallow /easter/*
Allow /easter/*/easter-eggs-2022-1113886m.html
Allow /easter/*/easter-giftset-2022---karma-1113887.html
Allow /easter/*/easter-giftset-2022--mehr-1113888.html
Allow /easter/*/easter-giftset-2022---sakura-1113886.html
Disallow *category-seo-text-*
Disallow *talisman-quiz*
Back to top

Other Records

Field Value
sitemap https://www.rituals.com/sitemap.xml
Back to top

Comments

  • Exclusion of internal shops/ duplicate locales
  • END locale exclusion
  • Legacy disallows
  • END legacy Disallows
  • 201708 - Expand Online KV - Catchall allow rule for resources
  • END catchall allow rule for resources
  • 201708 - Expand Online KV - Disallow robots from wasting crawl budget.
  • END Disallow robots from wasting crawl budget
  • 201708 - Expand Online KV - Specific allow for resources in the static folder which are used throughout the website for images and resources.
  • END specific allow for resources in static demandware folder
  • 201708 - Expand Online KV - Allow product pages for Google shopping feed; Note some other pages are also included but this is the best we can do.
  • END allow for Google shopping
  • 201708 - Expand Online KV - Allow urls to be de-indexed when products or pages are not present anymore because of demandware catchall intercept.
  • END de-indexed pages
  • 201710 - Expand Online KV - Exclude parameters from being crawled
  • END Exclude parameters
  • Search disallows
  • END Search disallows
  • Disallow Checkout
  • END Disallow Checkout
  • 201910 Prevent website from being crawled by InternetArchive Crawler
  • Advent 2022
  • Disallow gifting Fastlane 2021
  • Allow gifting Fastlane pages for ads purposes 2022
  • 2021 Disallow greenfriday site pages
  • 2022 Disallow easter site pages
  • 2022 Disallow individual SEO content assets
  • 2022 Disallow talisman quiz page
Back to top