Log In Sign Up

cromantic.com
robots.txt

Robots Exclusion Standard data for cromantic.com

Resource Scan

Scan Details

Site Domain cromantic.com
Base Domain cromantic.com
Scan Status Ok
Last Scan2024-09-17T04:10:57+00:00
Next Scan 2024-10-17T04:10:57+00:00

Last Scan

Scanned2024-09-17T04:10:57+00:00
URL https://www.cromantic.com/robots.txt
Domain IPs 13.35.18.129, 13.35.18.58, 13.35.18.81, 13.35.18.91, 2600:9000:20c7:2800:6:fa8d:7380:93a1, 2600:9000:20c7:4400:6:fa8d:7380:93a1, 2600:9000:20c7:4a00:6:fa8d:7380:93a1, 2600:9000:20c7:5a00:6:fa8d:7380:93a1, 2600:9000:20c7:9c00:6:fa8d:7380:93a1, 2600:9000:20c7:ba00:6:fa8d:7380:93a1, 2600:9000:20c7:bc00:6:fa8d:7380:93a1, 2600:9000:20c7:c000:6:fa8d:7380:93a1
Response IP 13.35.18.58
Found Yes
Hash fb01fd70ca26f4f293ff36feb6ba7bf5fc7a2d7ded741f6a3a22f56e8d8e6a3c
SimHash 8921bf388bb0

Groups

*

Rule Path Comment
Disallow /img/* -
Disallow /account/* -
Disallow /login/* -
Disallow /checkout/* -
Disallow /busca/* -
Disallow /quick-view/* -
Disallow /espiar/* -
Disallow /sistema/* -
Disallow /cuidado-de-la-piel/facial/mario-badescu/t%C3%83%C2%B3nico/* -
Disallow /maquillaje/ojos/Pesta%C3%83%C2%B1ina/pesta%C3%83%C2%B1ina-mineral-infused-black?PS=12&map=c%2Cc%2CspecificationFilter_24%2Cft%2F* -
Disallow /cuidado-de-la-piel/1003/esponja-ba%C3%83%C2%B1o-fresa-salon-expert?PS=12&map=c%2CproductClusterSearchableIds%2Cft%2F* -
Disallow /maquillaje/340/pesta%C3%83%C2%B1ina-mineral-infused-black?PS=12&map=c%2CproductClusterSearchableIds%2Cft%2F* -
Disallow /pesta%C3%83%C2%B1ina-mineral-infused-black/* -
Disallow /capilar/925/Seco-Deshidratado/Da%C3%83%C2%B1ado-Maltratado?O=OrderByReleaseDateDESC&PS=12&map=c%2CproductClusterSearchableIds%2CspecificationFilter_24%2Cft%2F* -
Disallow /maquillaje/rostro/alta/caf%C3%83%C2%A9/* -
Disallow /maquillaje/ojos/cejas/the-balm/caf%C3%83%C2%A9/* -
Disallow /busca?PS=20&map=c%2CproductClusterIds&%2F* -
Disallow /maquillaje/bys/duo/Media/maquillaje?PS=12&map=c%2Cb%2Cb%2CspecificationFilter_20%2Cft%2F* -
Disallow /busca?PS=12&map=c%2Cc%2CproductClusterIds&%2F* -
Disallow /maquillaje/ojos/pestanina/nee/340/Caf%C3%83%C2%A9/pesta%C3%83%C2%B1ina?PS=12&map=c%2Cc%2Cc%2Cb%2CproductClusterSearchableIds%2CspecificationFilter_25%2Cft%2F* -
Disallow /maquillaje/caf%C3%83%C2%A9_ 61380b/iluminadores/*
Disallow /busca?PS=12&map=c%2CproductClusterIds%2CproductClusterSearchableIds%2CspecificationFilter_40%2CspecificationFilter_25&%2F* -
Disallow /busca?%2F*PS=12&map=c%2Cc%2Cb%2CproductClusterIds%2CproductClusterSearchableIds%2CspecificationFilter_20%2CspecificationFilter_24&uam=true&mobile=4&%2F* -
Disallow /pesta%C3%83%C2%B1ina-maybelline-the-colossal-volum-express-waterproof-7702058280085/p/* -
Disallow /busca?PS=12&map=c%2Cc%2Cc%2CproductClusterIds%2CproductClusterSearchableIds%2CspecificationFilter_24%2CspecificationFilter_25&uam=true&mobile=4&%2F* -
Disallow /busca?PS=12&map=c%2CproductClusterIds%2CproductClusterSearchableIds%2CspecificationFilter_20%2CspecificationFilter_25&uam=true&mobile=4&%2F* -
Disallow /busca?PS=12&map=c%2Cb%2CproductClusterIds%2CspecificationFilter_20%2CspecificationFilter_24&%2F* -
Disallow /busca?PS=12&map=c%2Cc%2Cc%2Cb%2CproductClusterIds%2CspecificationFilter_24%2CspecificationFilter_20%2CproductClusterSearchableIds&uam=true&mobile=4&%2F* -
Disallow /busca?PS=12&map=c%2Cb%2CproductClusterIds%2CspecificationFilter_24%2CproductClusterSearchableIds&uam=true&mobile=4&%2F* -
Disallow /pesta%C3%83%C2%B1ina-studio-3-in1-very-black/p/* -
Disallow /capilar/revlon/Azul_?O=OrderByPriceDESC&PS=36%2F* -
Disallow /maquillaje/kits-de-maquillaje/171?O=OrderByPriceDESC&PS=12&map=c%2Cc%2CproductClusterSearchableIds%2F* -
Disallow /maquillaje/ojos/delineadores/bys/DELINEADORES?PS=24%2F* -
Disallow /maquillaje/ojos/218/Delineadores/Negro?PS=36&map=c%2Cc%2CproductClusterSearchableIds%2CspecificationFilter_24%2CspecificationFilter_25%2F* -
Disallow /busca?PS=12&map=c%2Cc%2Cc%2CproductClusterIds%2CspecificationFilter_24%2CproductClusterSearchableIds&%2F* -
Disallow /pesta%C3%83%C2%B1ina-cheater-57-g/p/* -
Disallow /busca?PS=12&map=c%2Cc%2Cc%2Cb%2CproductClusterIds%2CspecificationFilter_24%2CproductClusterSearchableIds&uam=true&mobile=4&%2F* -
Disallow /unas/posh/Esmalte -
Disallow /busca?PS=36&map=c%2Cc%2Cb%2CproductClusterIds&%2F* -
Disallow /busca?PS=20&map=c%2CproductClusterIds&%2F* -
Disallow /pesta%C3%83%C2%B1ina-maybelline-the-falsies-push-up-washable-very-black-blister-41554459906/p/* -
Disallow /pesta%C3%83%C2%B1ina-maybelline-colossal-big-shot-washable-very-black-7702058058899/p/* -
Disallow /busca?PS=36&map=c%2Cb%2CproductClusterIds&%2F* -
Disallow /1070/* -
Disallow /63680-cromantic-box/p/* -
Disallow /1129/* -
Disallow /1126/* -
Disallow /461/* -
Disallow /1230/* -
Disallow /1211/* -
Disallow /495/* -
Disallow /1092/* -
Disallow /1281/* -
Disallow /mascarilla-olaplex-n3/p/* -
Disallow /1278/* -
Disallow /1301/* -
Disallow /1302/* -
Disallow /488/* -
Disallow /maquillaje/488/* -
Disallow /rebajas/* -
Disallow /1318/* -
Disallow /495/* -
Disallow /1318/* -
Disallow /941/* -
Disallow /1051/* -
Disallow /1070/* -
Disallow /1118/* -
Disallow /1070/* -
Disallow /1118/* -
Disallow /1060/* -
Disallow /capilar/488/* -
Disallow /461/* -
Disallow /974/* -
Disallow /874/* -
Disallow /1254/* -
Disallow /1281/* -
Disallow /1125/* -
Disallow /1299/* -
Disallow /975/* -
Disallow /973/* -
Disallow /1126/* -
Disallow /blog-cromantic/* -
Back to top

Other Records

Field Value
sitemap http://www.cromantic.com/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
Back to top

Warnings

  • 13 invalid lines.
  • `noindex` is not a known field.
Back to top