agaval.com
robots.txt

Robots Exclusion Standard data for agaval.com

Resource Scan

Scan Details

Site Domain agaval.com
Base Domain agaval.com
Scan Status Ok
Last Scan2024-05-20T08:50:50+00:00
Next Scan 2024-06-19T08:50:50+00:00

Last Scan

Scanned2024-05-20T08:50:50+00:00
URL https://agaval.com/robots.txt
Redirect https://www.agaval.com/robots.txt
Redirect Domain www.agaval.com
Redirect Base agaval.com
Domain IPs 107.180.3.103
Redirect IPs 108.157.254.114, 108.157.254.14, 108.157.254.15, 108.157.254.98, 2600:9000:2753:1000:19:ede8:ec00:93a1, 2600:9000:2753:2000:19:ede8:ec00:93a1, 2600:9000:2753:2200:19:ede8:ec00:93a1, 2600:9000:2753:4600:19:ede8:ec00:93a1, 2600:9000:2753:5800:19:ede8:ec00:93a1, 2600:9000:2753:8000:19:ede8:ec00:93a1, 2600:9000:2753:bc00:19:ede8:ec00:93a1, 2600:9000:2753:da00:19:ede8:ec00:93a1
Response IP 108.157.254.114
Found Yes
Hash 65e3b51d5b1ac197be6a605416f353283b05d6a79451daa11435257946cd3187
SimHash 6cd025d69e22

Groups

*

Rule Path
Disallow /img/
Disallow /account/
Disallow /login/
Disallow /checkout/
Disallow /busca/
Disallow /quick-view/
Disallow /espiar/
Disallow /buscapagina/

*

Rule Path
Allow /*.css
Allow /*.jpeg
Allow /*.js
Allow /*.png
Allow /*.webp
Allow /*.jpg
Allow /*.svg
Allow /*.woff

*

Rule Path Comment
Disallow /secure/ -
Disallow /account/ -
Disallow /admin/ -
Disallow /busca/ -
Disallow /login/ -
Disallow /buscapagina -
Disallow /buscavazia -
Disallow /buscavazia/* -
Disallow /checkout/ -
Disallow /checkout/* -
Disallow /checkout /*
Disallow /checkout/ /cart
Disallow /checkout/cart/add -
Disallow /checkout /
Disallow /coleccion/ -
Disallow /control/ -
Disallow /espiar/ -
Disallow /files/ -
Disallow /img/ -
Disallow /lista-de-deseos -
Disallow /login -
Disallow /quick-view/ -
Disallow /Sistema/ -
Disallow /Sistema/404 -
Disallow /Sistema/buscavazia -
Disallow /wishlist -
Disallow /te-ayudamos -
Allow /_v/public/graphql/v1?workspace= -
Allow /_v/segment/graphql/v1?workspace= -
Allow /_v/private/graphql/v1?workspace= -
Allow /api/vtexid/pub/authentication/providers?scope= -
Allow /_v/segment/routing/vtex.store%402.x/*device%3D* -
Allow /*?__pickRuntime=*device=* -
Allow /_v/public/vtex.styles-graphql/v1/font/*.otf -
Allow /_v/public/vtex.styles-graphql/v1/font/*.ttf -
Allow /_v/public/vtex.styles-graphql/v1/fonts/*workspace%3D* -
Allow /arquivos/ids/*width%3D* -

*

Rule Path
Disallow /*?
Disallow /*%26
Disallow /*%
Disallow /*/d$
Allow /api/sessions
Allow /*?idsku=
Allow /*?page=
Allow /*utm_
Disallow /*?page=*&

*

Rule Path
Disallow /*.aspx

Other Records

Field Value
sitemap https://www.agaval.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.
  • ALLOWs QUE DEBEN ESTAR SIEMPRE
  • URLS NO DEBEN APARECER
  • JSON RASTREABLES
  • vtexassets RASTREABLES IMG
  • DISALLOW URL PARAMETROS
  • ALLOW URL PARAMETROS: IMPORTANTE MERCHANT
  • EVITAR 404 ERRORES
  • SITEMAPS