rarecarat.com
robots.txt

Robots Exclusion Standard data for rarecarat.com

Resource Scan

Scan Details

Site Domain rarecarat.com
Base Domain rarecarat.com
Scan Status Ok
Last Scan2024-09-28T17:05:52+00:00
Next Scan 2024-10-28T17:05:52+00:00

Last Scan

Scanned2024-09-28T17:05:52+00:00
URL https://rarecarat.com/robots.txt
Redirect https://www.rarecarat.com/robots.txt
Redirect Domain www.rarecarat.com
Redirect Base rarecarat.com
Domain IPs 104.26.2.80, 104.26.3.80, 172.67.69.161
Redirect IPs 104.26.2.80, 104.26.3.80, 172.67.69.161
Response IP 104.26.3.80
Found Yes
Hash 287fd634c9d91bf07c813a0eab513e8352f749c2d6973f94abdab9af0695b3b5
SimHash 48848a6d4963

Groups

*

Rule Path
Allow /diamonds/slp/*
Allow /diamond-report
Allow /settings/slp/*
Allow /diamonds
Allow /settings
Allow /setting/*
Allow /diamond/*
Allow /wedding-rings
Allow /wedding-ring/*
Allow /mens-wedding-bands
Allow /privacy

*

Rule Path
Disallow /lab-created-diamonds
Disallow /shop-engagement-rings
Disallow /my-stuff
Disallow /my-stuff/*
Disallow /signin
Disallow /admin
Disallow /unsubscribe
Disallow /redirect
Disallow /x1
Disallow /diamond-details
Disallow /Retailer/GetRetailersInformation
Disallow /opendiamondurl/
Disallow /appointment/
Disallow /checkout/
Disallow /orders/
Disallow /product
Disallow /ring-detail
Disallow /terms-of-service
Disallow /diamond/*/RT
Disallow /diamond-search/
Disallow /diamond-search/*
Disallow /setting-search/
Disallow /setting-search/*

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.rarecarat.com/sitemap.xml
sitemap https://www.rarecarat.com/blogsitemap.xml
sitemap https://www.rarecarat.com/lab-diamonds-sitemap.xml
sitemap https://www.rarecarat.com/natural-diamonds-sitemap.xml
sitemap https://www.rarecarat.com/slp-sitemap.xml