rarecarat.com
robots.txt
Robots Exclusion Standard data for rarecarat.com
Resource Scan
Scan Details
Site Domain | rarecarat.com |
Base Domain | rarecarat.com |
Scan Status | Ok |
Last Scan | 2024-10-28T17:16:36+00:00 |
Next Scan | 2024-11-27T17:16:36+00:00 |
Last Scan
Scanned | 2024-10-28T17:16:36+00:00 |
URL | https://rarecarat.com/robots.txt |
Redirect | https://www.rarecarat.com/robots.txt |
Redirect Domain | www.rarecarat.com |
Redirect Base | rarecarat.com |
Domain IPs | 104.26.2.80, 104.26.3.80, 172.67.69.161 |
Redirect IPs | 104.26.2.80, 104.26.3.80, 172.67.69.161 |
Response IP | 104.26.2.80 |
Found | Yes |
Hash | 287fd634c9d91bf07c813a0eab513e8352f749c2d6973f94abdab9af0695b3b5 |
SimHash | 48848a6d4963 |
Groups
*
Rule | Path |
---|---|
Allow | /diamonds/slp/* |
Allow | /diamond-report |
Allow | /settings/slp/* |
Allow | /diamonds |
Allow | /settings |
Allow | /setting/* |
Allow | /diamond/* |
Allow | /wedding-rings |
Allow | /wedding-ring/* |
Allow | /mens-wedding-bands |
Allow | /privacy |
*
Rule | Path |
---|---|
Disallow | /lab-created-diamonds |
Disallow | /shop-engagement-rings |
Disallow | /my-stuff |
Disallow | /my-stuff/* |
Disallow | /signin |
Disallow | /admin |
Disallow | /unsubscribe |
Disallow | /redirect |
Disallow | /x1 |
Disallow | /diamond-details |
Disallow | /Retailer/GetRetailersInformation |
Disallow | /opendiamondurl/ |
Disallow | /appointment/ |
Disallow | /checkout/ |
Disallow | /orders/ |
Disallow | /product |
Disallow | /ring-detail |
Disallow | /terms-of-service |
Disallow | /diamond/*/RT |
Disallow | /diamond-search/ |
Disallow | /diamond-search/* |
Disallow | /setting-search/ |
Disallow | /setting-search/* |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | https://www.rarecarat.com/sitemap.xml |
sitemap | https://www.rarecarat.com/blogsitemap.xml |
sitemap | https://www.rarecarat.com/lab-diamonds-sitemap.xml |
sitemap | https://www.rarecarat.com/natural-diamonds-sitemap.xml |
sitemap | https://www.rarecarat.com/slp-sitemap.xml |