carter-cash.com
robots.txt
Robots Exclusion Standard data for carter-cash.com
Resource Scan
Scan Details
| Site Domain | carter-cash.com |
| Base Domain | carter-cash.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-02-07T19:18:27+00:00 |
| Next Scan | 2025-04-08T19:18:27+00:00 |
Last Successful Scan
| Scanned | 2024-12-16T19:17:30+00:00 |
| URL | https://carter-cash.com/robots.txt |
| Redirect | https://www.carter-cash.com/robots.txt |
| Redirect Domain | www.carter-cash.com |
| Redirect Base | carter-cash.com |
| Domain IPs | 89.185.44.24 |
| Redirect IPs | 104.18.28.38, 104.18.29.38, 2606:4700::6812:1c26, 2606:4700::6812:1d26 |
| Response IP | 104.18.28.38 |
| Found | Yes |
| Hash | f7db00a1548bf97cb10ccf5ae6c8c72d6548f6d5ad0343e38f64c784ba4dba7f |
| SimHash | 3b167941c413 |
Groups
baiduspider
bnf.fr_bot
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
seznambot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twengabot
twiceler
voilabot
voilabot beta 1.2
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yandex
yandexbot
yandeximages
yandexwebmaster
yeti
yodaobot
zyborg
amazonbot
gptbot
ai2bot
ai2bot-dolma
anthropic-ai
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
diffbot
friendlycrawler
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
oai-searchbot
omgili
omgilibot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /duplicata/* |
| Disallow | /panier |
| Disallow | /livraison/etape/1 |
| Disallow | /adresse |
| Disallow | /suivi |
| Disallow | /paiement |
| Disallow | /blog/type/* |
| Disallow | /blog/category/* |
| Disallow | /blog/?s* |
| Disallow | /blog/author/* |
| Disallow | */comment-page* |
| Disallow | */carselector/* |
| Disallow | /recherche?query=* |
| Disallow | /authentification* |
| Disallow | /compte/* |
| Disallow | /emplois |
| Disallow | /oauth |
| Disallow | *?_token=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.carter-cash.com/sitemap/fr/sitemap-index.xml |
Comments