realself.com
robots.txt

Robots Exclusion Standard data for realself.com

Resource Scan

Scan Details

Site Domain realself.com
Base Domain realself.com
Scan Status Ok
Last Scan2024-06-02T05:29:02+00:00
Next Scan 2024-06-09T05:29:02+00:00

Last Scan

Scanned2024-06-02T05:29:02+00:00
URL https://realself.com/robots.txt
Redirect https://www.realself.com/robots.txt
Redirect Domain www.realself.com
Redirect Base realself.com
Domain IPs 151.101.1.63, 151.101.129.63, 151.101.193.63, 151.101.65.63
Redirect IPs 151.101.1.63, 151.101.129.63, 151.101.193.63, 151.101.65.63
Response IP 151.101.193.63
Found Yes
Hash e29930b17e7630b39f5b5c7e0d86ebceaa3c56028db6206c061c7e41e16fa32c
SimHash 6b679b67eddb

Groups

*

Rule Path
Disallow /*/getSpotlightIdV2?*
Disallow /answer/*/vote
Disallow /ask-a-doctor?
Disallow /comment/reply/
Disallow /comment/api/threadv2?*
Disallow /comment/api/topLevelCommentCountv2?*
Disallow /comment/api/repliesv2?*
Disallow /discussion/*/create
Disallow /discussion/loadMore*
Disallow /dr/spotlightPhotosV2?*
Disallow /practice/spotlightPhotosV2?*
Disallow /drsearch?*
Disallow /drsearch/paginatedContent?*
Disallow /drsearch/brandProgramBadgeV2
Disallow /fragmentv2?*
Disallow /find/*?rangev2
Disallow /find/*-nearby-me
Disallow /kraken/apiv2
Disallow /homefeed
Disallow /chat
Disallow /landingpage
Disallow /lead/form
Disallow /minvasiveSem
Disallow /photo/*/vote
Disallow /practice/recordViews
Disallow /real-beauty-news
Disallow /review/*/vote
Disallow /review/entriesV2?*
Disallow /review/write?*
Disallow /search?*
Disallow /search/relatedReviewsv2
Disallow /site/incrementViews
Disallow /sitesearch?*
Disallow /spotlightanswerv2?*
Disallow /spotlight/statsv2?*
Disallow /stream/
Disallow /topic/*/reviewFilter
Disallow /topic/*/worthitstats
Disallow /user/
Disallow /userprofile/
Disallow /vote_up_down/
Disallow /widget/*
Disallow /doctor-comparison

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.realself.com/XMLSitemap
sitemap https://www.realself.com/news/sitemap_index.xml