casa-magna.com
robots.txt

Robots Exclusion Standard data for casa-magna.com

Resource Scan

Scan Details

Site Domain casa-magna.com
Base Domain casa-magna.com
Scan Status Ok
Last Scan2024-10-17T05:15:59+00:00
Next Scan 2024-11-16T05:15:59+00:00

Last Scan

Scanned2024-10-17T05:15:59+00:00
URL https://www.casa-magna.com/robots.txt
Domain IPs 108.157.254.42, 108.157.254.47, 108.157.254.7, 108.157.254.74, 2600:9000:2753:4200:13:6988:3a00:93a1, 2600:9000:2753:d000:13:6988:3a00:93a1, 2600:9000:2753:d600:13:6988:3a00:93a1, 2600:9000:2753:dc00:13:6988:3a00:93a1, 2600:9000:2753:e200:13:6988:3a00:93a1, 2600:9000:2753:e600:13:6988:3a00:93a1, 2600:9000:2753:f600:13:6988:3a00:93a1, 2600:9000:2753:fc00:13:6988:3a00:93a1
Response IP 108.157.254.74
Found Yes
Hash 70e76323d45018d8b8b18925ffab66a9dc16f2ae9424259f2b82f5bf11d10635
SimHash 3cd415de9eb5

Groups

*

Rule Path Comment
Disallow /img/ -
Disallow /account/ -
Disallow /login/ -
Disallow /checkout/ -
Disallow /busca/ -
Disallow /quick-view/ -
Disallow /espiar/ -
Disallow /buscapagina/ -
Disallow /secure/ -
Disallow /admin/ -
Disallow /coleccion/ -
Disallow /control/ -
Disallow /files/ -
Disallow /lista-de-deseos -
Disallow /wishlist -
Disallow /te-ayudamos -
Disallow /Sistema/ -
Disallow /Sistema/404 -
Disallow /Sistema/buscavazia -
Disallow /buscavazia/* -
Disallow /checkout /*
Disallow /checkout/ /cart
Disallow /checkout/cart/add -

*

Rule Path
Allow /*.css
Allow /*.jpeg
Allow /*.js
Allow /*.png
Allow /*.webp
Allow /*.jpg
Allow /*.svg
Allow /*.woff
Allow /*.gif
Allow /arquivos/ids/*width%3D*
Allow /_v/public/graphql/v1?workspace=
Allow /_v/segment/graphql/v1?workspace=
Allow /_v/private/graphql/v1?workspace=
Allow /api/vtexid/pub/authentication/providers?scope=
Allow /_v/segment/routing/vtex.store%402.x/*device%3D*
Allow /*?__pickRuntime=*device=*
Allow /_v/public/vtex.styles-graphql/v1/font/*.otf
Allow /_v/public/vtex.styles-graphql/v1/fonts/*workspace%3D*
Allow /*sessions?items=
Allow /*search?fq=

*

Rule Path
Disallow /*?
Disallow /*%
Disallow /*/d$
Disallow /*page%3D*%26map%3D
Allow /*?idsku=
Allow /*?skuId=
Allow /*?page=

*

Rule Path
Disallow /*.aspx

Other Records

Field Value
sitemap https://www.casa-magna.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages
  • Allow specific file types
  • JSON RASTREABLES
  • DISALLOW URL PARAMETERS
  • ALLOW URL PARAMETERS: IMPORTANT MERCHANT
  • AVOID 404 ERRORS
  • SITEMAPS