calvinklein.co
robots.txt
Robots Exclusion Standard data for calvinklein.co
Resource Scan
Scan Details
| Site Domain | calvinklein.co |
| Base Domain | calvinklein.co |
| Scan Status | Ok |
| Last Scan | 2024-09-13T08:57:16+00:00 |
| Next Scan | 2024-10-13T08:57:16+00:00 |
Last Scan
| Scanned | 2024-09-13T08:57:16+00:00 |
| URL | https://www.calvinklein.co/robots.txt |
| Domain IPs | 13.225.4.16, 13.225.4.2, 13.225.4.32, 13.225.4.91, 2600:9000:21b4:200:8:dcda:6680:93a1, 2600:9000:21b4:2200:8:dcda:6680:93a1, 2600:9000:21b4:7200:8:dcda:6680:93a1, 2600:9000:21b4:b800:8:dcda:6680:93a1, 2600:9000:21b4:c000:8:dcda:6680:93a1, 2600:9000:21b4:c200:8:dcda:6680:93a1, 2600:9000:21b4:d000:8:dcda:6680:93a1, 2600:9000:21b4:e600:8:dcda:6680:93a1 |
| Response IP | 13.225.4.2 |
| Found | Yes |
| Hash | e17ca7d086e6bcec54fcc1c79455c9d244f4e6997ed7e085ee88e52f10e67a1b |
| SimHash | 6cd26d12ae0d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /img/ |
| Disallow | /account/ |
| Disallow | /login/ |
| Disallow | /checkout/ |
| Disallow | /busca/ |
| Disallow | /quick-view/ |
| Disallow | /espiar/ |
| Disallow | /buscapagina/ |
*
| Rule | Path |
|---|---|
| Allow | /*.css |
| Allow | /*.jpeg |
| Allow | /*.js |
| Allow | /*.png |
| Allow | /*.webp |
| Allow | /*.jpg |
| Allow | /*.svg |
| Allow | /*.woff |
| Allow | /*.gif |
| Allow | /*.ico |
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /secure/ | - |
| Disallow | /_secure/ | - |
| Disallow | /account/ | - |
| Disallow | /account | - |
| Disallow | /admin/ | - |
| Disallow | /busca/ | - |
| Disallow | /login | - |
| Disallow | /logout | - |
| Disallow | /buscapagina | - |
| Disallow | /buscavazia | - |
| Disallow | /buscavazia/* | - |
| Disallow | /checkout/ | - |
| Disallow | /checkout/* | - |
| Disallow | /checkout | /* |
| Disallow | /checkout/ | /cart |
| Disallow | /checkout/cart/add | - |
| Disallow | /checkout | / |
| Disallow | /coleccion/ | - |
| Disallow | /control/ | - |
| Disallow | /espiar/ | - |
| Disallow | /files/ | - |
| Allow | /files/*.css | - |
| Allow | /files/*.js | - |
| Allow | /files/*.json | - |
| Disallow | /img/ | - |
| Disallow | /lista-de-deseos | - |
| Disallow | /login | - |
| Disallow | /quick-view/ | - |
| Disallow | /Sistema/ | - |
| Disallow | /Sistema/404 | - |
| Disallow | /Sistema/buscavazia | - |
| Disallow | /wishlist | - |
| Disallow | /te-ayudamos | - |
| Disallow | /guatemala/ | - |
| Disallow | /panama/ | - |
| Disallow | /chile/ | - |
| Disallow | /colombia/ | - |
| Allow | /api/ | - |
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*%26 |
| Disallow | /*% |
| Disallow | /*/calvin-klein |
| Allow | /*?idsku= |
| Allow | /*?skuid= |
| Allow | /*?page= |
*
| Rule | Path |
|---|---|
| Disallow | /*.aspx |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.calvinklein.co/sitemap.xml |
Comments