cerave.com
robots.txt
Robots Exclusion Standard data for cerave.com
Resource Scan
Scan Details
| Site Domain | cerave.com |
| Base Domain | cerave.com |
| Scan Status | Ok |
| Last Scan | 2024-06-17T20:59:17+00:00 |
| Next Scan | 2024-07-01T20:59:17+00:00 |
Last Scan
| Scanned | 2024-06-17T20:59:17+00:00 |
| URL | https://cerave.com/robots.txt |
| Redirect | https://www.cerave.com/robots.txt |
| Redirect Domain | www.cerave.com |
| Redirect Base | cerave.com |
| Domain IPs | 104.18.37.175, 172.64.150.81, 2606:4700:4400::6812:25af, 2606:4700:4400::ac40:9651 |
| Redirect IPs | 104.18.37.175, 172.64.150.81, 2606:4700:4400::6812:25af, 2606:4700:4400::ac40:9651 |
| Response IP | 172.64.150.81 |
| Found | Yes |
| Hash | 4d27905ea127378aff4114d9d18bcc7cb24f029432b4e9f06cd70a540e7949dd |
| SimHash | a884a43d8dd1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /es/ |
| Disallow | /xsl/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /App_Data/ |
| Disallow | /App_config/ |
| Disallow | /prosamples/ |
| Disallow | /App_Browsers/ |
| Disallow | /sitecore_files/ |
| Disallow | /es/skin-smarts/ |
| Disallow | /es/skin-smarts/skincare-for-baby/ |
| Disallow | /es/skin-smarts/skincare-routines/ |
| Disallow | /es/skin-smarts/skincare-tips-advice/ |
| Disallow | /es/skin-smarts/skincare-for-baby/3-common-baby-rashes/ |
| Disallow | /es/skin-smarts/skincare-for-baby/baby-acne-what-every-parent-needs-to-know/ |
| Disallow | /es/skin-smarts/skincare-for-baby/3-nourishing-ingredients-your-baby-needs-for-healthy-skin/ |
| Disallow | /es/skin-smarts/skincare-for-baby/suncare-for-babys-sensitive-skin-4-facts-every-parent-needs-to-know/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cerave.com/sitemap-index.xml |
Warnings
- 1 invalid line.