pl.caudalie.com
robots.txt
Robots Exclusion Standard data for pl.caudalie.com
Resource Scan
Scan Details
| Site Domain | pl.caudalie.com |
| Base Domain | caudalie.com |
| Scan Status | Ok |
| Last Scan | 2025-03-04T00:28:34+00:00 |
| Next Scan | 2025-03-18T00:28:34+00:00 |
Last Scan
| Scanned | 2025-03-04T00:28:34+00:00 |
| URL | https://pl.caudalie.com/robots.txt |
| Domain IPs | 108.156.144.104, 108.156.144.121, 108.156.144.30, 108.156.144.62, 2600:9000:2755:1600:1d:4ee7:3840:93a1, 2600:9000:2755:1a00:1d:4ee7:3840:93a1, 2600:9000:2755:4200:1d:4ee7:3840:93a1, 2600:9000:2755:ae00:1d:4ee7:3840:93a1, 2600:9000:2755:c000:1d:4ee7:3840:93a1, 2600:9000:2755:e000:1d:4ee7:3840:93a1, 2600:9000:2755:ec00:1d:4ee7:3840:93a1, 2600:9000:2755:fa00:1d:4ee7:3840:93a1 |
| Response IP | 108.156.144.30 |
| Found | Yes |
| Hash | 3d2643ebfbfec252dfe662f2640d4e2cfcdbbf99e77c732469cf60120968ee2a |
| SimHash | ef055c54c391 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.css$ |
| Disallow | /*.js$ |
| Disallow | /*.php$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pl.caudalie.com/sitemap.xml |