sephora.i.lithium.com
robots.txt

Robots Exclusion Standard data for sephora.i.lithium.com

Resource Scan

Scan Details

Site Domain sephora.i.lithium.com
Base Domain lithium.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-01T14:46:39+00:00
Next Scan 2025-07-31T14:46:39+00:00

Last Successful Scan

Scanned2025-03-11T14:19:48+00:00
URL https://sephora.i.lithium.com/robots.txt
Redirect https://community.sephora.com:443/robots.txt
Redirect Domain community.sephora.com
Redirect Base sephora.com
Domain IPs 44.235.42.26, 52.13.104.115, 54.213.94.214
Redirect IPs 3.169.71.118, 3.169.71.47, 3.169.71.52, 3.169.71.72
Response IP 18.165.122.94
Found Yes
Hash 9c11ac16cab01f4ddfd007dc9cfc226b95dc0912acbaa1b622f6af6f1847c19f
SimHash fd68fac0fbb0

Groups

*

Rule Path
Disallow /t5/forums/forumtopicprintpage
Disallow /t5/ideas/ideaprintpage
Disallow /t5/blogs/blogarticleprintpage
Disallow /t5/tkb/allarticlesprintpage
Disallow /t5/tkb/articleprintpage
Disallow /t5/contests/contestprintpage
Disallow /t5/media/gallerypage/tab/all/
Disallow /t5/media/gallerypage/tab/all?
Disallow /t5/media/gallerypage/tab/all$
Disallow /t5/media/gallerypage/*/tab/all/
Disallow /t5/media/gallerypage/*/tab/all?
Disallow /t5/media/gallerypage/*/tab/all$
Disallow /t5/media/v*/gallerypage/tab/all/
Disallow /t5/media/v*/gallerypage/tab/all?
Disallow /t5/media/v*/gallerypage/tab/all$
Disallow /t5/media/v*/gallerypage/*/tab/all/
Disallow /t5/media/v*/gallerypage/*/tab/all?
Disallow /t5/media/v*/gallerypage/*/tab/all$
Disallow /t5/help/faqpage
Disallow /sephora/rss
Disallow /t5/forums/kudosleaderboardpage
Disallow /t5/kudos/userpage/user-id/*/tab/
Disallow /t5/kudos/messagepage/board-id/*/message-id/*/tab/
Disallow /t5/forums/usersonlinepage
Disallow /*?t%3Aac=
Disallow /*%26t%3Aac%3D
Disallow /t5/util/componentrenderpage
Disallow /*%3Alightboxrendercomponent?
Disallow /*%3Alightboxrendercomponent%26
Disallow /*%3Alightboxrendercomponent/
Disallow /*%3Akudoentity?
Disallow /*%3Akudoentity%26
Disallow /*%3Akudoentity/
Disallow /*?ticket=
Disallow /*%26ticket%3D
Disallow /t5/community/page.logoutpage
Disallow /t5/forums/postpage
Disallow /t5/forums/recentpostspage
Disallow /t5/forums/replypage
Disallow /t5/tkb/articlehistorypage
Disallow /t5/notes/composepage
Disallow /t5/notes/privatenotespage/tab/compose
Disallow /t5/notes/v*/privatenotespage/tab/compose
Disallow /t5/notifications/notifymoderatorpage
Disallow /t5/user/mfapage
Disallow /t5/user/loginpage
Disallow /t5/user/registrationpage
Disallow /t5/user/userregistrationpage
Disallow /*nobounce
Disallow /auth/
Disallow /plugins/common/feature/oauth/
Disallow /plugins/common/feature/oauth2sso/
Disallow /plugins/common/feature/saml/
Disallow /plugins/common/feature/openidconnectsso/
Disallow /plugins/common/feature/openidsso/
Disallow /t5/contentarchivals/
Disallow /t5/occasions/createoccasionpage
Disallow /t5/occasions/editoccasionpage
Disallow /t5/blogs/blogworkflowpage
Disallow /t5/tkb/workflowpage
Disallow */custom-sephora-footer-social-link.url-07
Disallow */custom-sephora-header-user.recommendations.url

Other Records

Field Value
crawl-delay 5

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://community.sephora.com/sitemap.xml