rarecarat.com
robots.txt
Robots Exclusion Standard data for rarecarat.com
Resource Scan
Scan Details
| Site Domain | rarecarat.com |
| Base Domain | rarecarat.com |
| Scan Status | Ok |
| Last Scan | 2024-05-31T16:25:25+00:00 |
| Next Scan | 2024-06-30T16:25:25+00:00 |
Last Scan
| Scanned | 2024-05-31T16:25:25+00:00 |
| URL | https://rarecarat.com/robots.txt |
| Redirect | https://www.rarecarat.com/robots.txt |
| Redirect Domain | www.rarecarat.com |
| Redirect Base | rarecarat.com |
| Domain IPs | 104.26.2.80, 104.26.3.80, 172.67.69.161 |
| Redirect IPs | 104.26.2.80, 104.26.3.80, 172.67.69.161 |
| Response IP | 104.26.2.80 |
| Found | Yes |
| Hash | d19e1e7e8301b487362ea3b7fd10b7da90d64b56722b672e7ea7d787126d536c |
| SimHash | 4884886d4963 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /diamonds/slp/* |
| Allow | /diamond-report |
| Allow | /settings/slp/* |
| Allow | /diamonds |
| Allow | /setting/* |
| Allow | /diamond/* |
| Allow | /wedding-rings |
| Allow | /wedding-ring/* |
| Allow | /mens-wedding-bands |
| Allow | /privacy |
*
| Rule | Path |
|---|---|
| Disallow | /my-stuff |
| Disallow | /my-stuff/* |
| Disallow | /signin |
| Disallow | /admin |
| Disallow | /unsubscribe |
| Disallow | /redirect |
| Disallow | /x1 |
| Disallow | /diamond-details |
| Disallow | /Retailer/GetRetailersInformation |
| Disallow | /opendiamondurl/ |
| Disallow | /appointment/ |
| Disallow | /checkout/ |
| Disallow | /orders/ |
| Disallow | /product |
| Disallow | /ring-detail |
| Disallow | /terms-of-service |
| Disallow | /diamond/*/RT |
| Disallow | /diamond-search/* |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rarecarat.com/sitemap.xml |
| sitemap | https://www.rarecarat.com/blogsitemap.xml |
| sitemap | https://www.rarecarat.com/lab-diamonds-sitemap.xml |
| sitemap | https://www.rarecarat.com/natural-diamonds-sitemap.xml |
| sitemap | https://www.rarecarat.com/slp-sitemap.xml |