charleskeith.eu
robots.txt
Robots Exclusion Standard data for charleskeith.eu
Resource Scan
Scan Details
| Site Domain | charleskeith.eu |
| Base Domain | charleskeith.eu |
| Scan Status | Ok |
| Last Scan | 2025-12-14T02:10:30+00:00 |
| Next Scan | 2025-12-28T02:10:30+00:00 |
Last Scan
| Scanned | 2025-12-14T02:10:30+00:00 |
| URL | https://charleskeith.eu/robots.txt |
| Redirect | https://www.charleskeith.eu/robots.txt |
| Redirect Domain | www.charleskeith.eu |
| Redirect Base | charleskeith.eu |
| Domain IPs | 13.248.160.137, 76.223.34.124 |
| Redirect IPs | 104.18.28.181, 104.18.29.181 |
| Response IP | 104.18.29.181 |
| Found | Yes |
| Hash | c20ea1711718fe3188c1535e5df328e0553bfc04b748714a1fcbbbb0b29f0f56 |
| SimHash | 6619df527ff6 |
Groups
claude-web
| Rule | Path |
|---|---|
| Disallow | *contentsearch* |
| Disallow | *srule* |
| Disallow | /cart |
| Disallow | /*/cart |
| Disallow | /*/orderconfirmation |
| Disallow | /*/revieworder |
| Disallow | /*/thank-you |
| Disallow | /*/check-out |
| Disallow | /login |
| Disallow | *?q=* |
| Disallow | /CSRF-Fail |
| Disallow | /on/demandware.store/* |
| Disallow | */Search-Show |
| Disallow | /*/profile |
| Disallow | /*/account |
| Disallow | /*/orders |
| Disallow | /*/order-details* |
| Disallow | /*/my-preferences |
| Disallow | /*/addressbook |
| Disallow | /*/wallet |
| Allow | /*/wallets |
| Disallow | /*/membership |
| Allow | /*/thank-you-mothers-day |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.charleskeith.eu/fr/sitemap_index.xml |
| sitemap | https://www.charleskeith.eu/de/sitemap_index.xml |
| sitemap | https://www.charleskeith.eu/mt/sitemap_index.xml |
| sitemap | https://www.charleskeith.eu/ch/sitemap_index.xml |
| sitemap | https://www.charleskeith.eu/no/sitemap_index.xml |
Comments