realself.com
robots.txt
Robots Exclusion Standard data for realself.com
Resource Scan
Scan Details
| Site Domain | realself.com |
| Base Domain | realself.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T21:15:27+00:00 |
| Next Scan | 2024-11-17T21:15:27+00:00 |
Last Scan
| Scanned | 2024-11-10T21:15:27+00:00 |
| URL | https://realself.com/robots.txt |
| Redirect | https://www.realself.com/robots.txt |
| Redirect Domain | www.realself.com |
| Redirect Base | realself.com |
| Domain IPs | 151.101.1.63, 151.101.129.63, 151.101.193.63, 151.101.65.63 |
| Redirect IPs | 151.101.1.63, 151.101.129.63, 151.101.193.63, 151.101.65.63 |
| Response IP | 151.101.129.63 |
| Found | Yes |
| Hash | 7652b5d621840834c58a20e4f2ad2c00084b5808dc688567012eb9b793ebd401 |
| SimHash | 6b479b67ed93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/getSpotlightIdV2?* |
| Disallow | /answer/*/vote |
| Disallow | /ask-a-doctor? |
| Disallow | /comment/reply/ |
| Disallow | /comment/api/threadv2?* |
| Disallow | /comment/api/topLevelCommentCountv2?* |
| Disallow | /comment/api/repliesv2?* |
| Disallow | /discussion/*/create |
| Disallow | /discussion/loadMore* |
| Disallow | /dr/spotlightPhotosV2?* |
| Disallow | /practice/spotlightPhotosV2?* |
| Disallow | /drsearch?* |
| Disallow | /drsearch/paginatedContent?* |
| Disallow | /drsearch/brandProgramBadgeV2 |
| Disallow | /fragmentv2?* |
| Disallow | /find/*?rangev2 |
| Disallow | /kraken/apiv2 |
| Disallow | /homefeed |
| Disallow | /chat |
| Disallow | /landingpage |
| Disallow | /lead/form |
| Disallow | /minvasiveSem |
| Disallow | /photo/*/vote |
| Disallow | /practice/recordViews |
| Disallow | /real-beauty-news |
| Disallow | /review/*/vote |
| Disallow | /review/entriesV2?* |
| Disallow | /review/write?* |
| Disallow | /search?* |
| Disallow | /search/relatedReviewsv2 |
| Disallow | /site/incrementViews |
| Disallow | /sitesearch?* |
| Disallow | /spotlightanswerv2?* |
| Disallow | /spotlight/statsv2?* |
| Disallow | /stream/ |
| Disallow | /topic/*/reviewFilter |
| Disallow | /topic/*/worthitstats |
| Disallow | /user/ |
| Disallow | /userprofile/ |
| Disallow | /vote_up_down/ |
| Disallow | /widget/* |
| Disallow | /doctor-comparison |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.realself.com/XMLSitemap |
| sitemap | https://www.realself.com/news/sitemap_index.xml |