gr.caudalie.com
robots.txt
Robots Exclusion Standard data for gr.caudalie.com
Resource Scan
Scan Details
| Site Domain | gr.caudalie.com |
| Base Domain | caudalie.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-18T04:55:14+00:00 |
| Next Scan | 2025-11-17T04:55:14+00:00 |
Last Successful Scan
| Scanned | 2025-07-13T16:24:43+00:00 |
| URL | https://gr.caudalie.com/robots.txt |
| Domain IPs | 13.35.37.114, 13.35.37.126, 13.35.37.40, 13.35.37.95, 2600:9000:213e:3400:2:29b1:5640:93a1, 2600:9000:213e:4000:2:29b1:5640:93a1, 2600:9000:213e:9000:2:29b1:5640:93a1, 2600:9000:213e:a400:2:29b1:5640:93a1, 2600:9000:213e:b000:2:29b1:5640:93a1, 2600:9000:213e:c400:2:29b1:5640:93a1, 2600:9000:213e:c800:2:29b1:5640:93a1, 2600:9000:213e:d200:2:29b1:5640:93a1 |
| Response IP | 13.35.37.126 |
| Found | Yes |
| Hash | 0af01f5fe004fccb20a1234ca5530f07edf90c0c3d49c5842e94c94984c5ba4f |
| SimHash | ef155c54c391 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.css$ |
| Disallow | /*.js$ |
| Disallow | /*.php$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gr.caudalie.com/sitemap.xml |