Log In Sign Up

calzafino.com
robots.txt

Robots Exclusion Standard data for calzafino.com

Resource Scan

Scan Details

Site Domain calzafino.com
Base Domain calzafino.com
Scan Status Ok
Last Scan2026-02-12T00:16:15+00:00
Next Scan 2026-03-14T00:16:15+00:00

Last Scan

Scanned2026-02-12T00:16:15+00:00
URL https://calzafino.com/robots.txt
Domain IPs 172.66.40.241, 172.66.43.15, 2606:4700:3108::ac42:28f1, 2606:4700:3108::ac42:2b0f
Response IP 172.66.40.241
Found Yes
Hash f7c17b592d85ecb305e3f969f89ca7fdf93d6a8c055a40290a62e5b1e0e89261
SimHash 20067a55eef2

Groups

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /media/catalog/product/
Allow /media/catalog/category/
Allow /en/media/catalog/product/
Allow /en/media/catalog/category/
Disallow /media/catalog/product/*?width=
Disallow /media/catalog/product/*%26height%3D
Disallow /media/catalog/category/*?width=
Disallow /media/catalog/category/*%26height%3D
Disallow /en/media/catalog/product/*?width=
Disallow /en/media/catalog/product/*%26height%3D
Disallow /en/media/catalog/category/*?width=
Disallow /en/media/catalog/category/*%26height%3D

msnbot-media

Rule Path
Allow /media/catalog/product/
Allow /media/catalog/category/
Allow /en/media/catalog/product/
Allow /en/media/catalog/category/

*

Rule Path
Disallow /media/
Allow /media/catalog/product/
Allow /media/catalog/category/
Allow /media/logo/
Allow /media/sitemap/
Disallow /en/media/
Allow /en/media/catalog/product/
Allow /en/media/catalog/category/
Allow /en/media/logo/
Allow /en/media/sitemap/
Allow /*?p=
Allow /*?page=
Allow /en/*?p=
Allow /en/*?page=
Disallow /rest/
Disallow /graphql
Disallow /en/rest/
Disallow /en/graphql
Disallow /*?*utm_
Disallow /en/*?*utm_
Disallow /*SID%3D
Disallow /en/*SID%3D
Disallow /*?*___store=
Disallow /en/*?*___store=
Disallow /*?*___from_store=
Disallow /en/*?*___from_store=
Disallow /*?*calzado_tipo=
Disallow /*?*material_calzado=
Disallow /*?*fabricante_calzado=
Disallow /*?*color=
Disallow /*?*estilo=
Disallow /*?*catalogo=
Disallow /*?*gender=
Disallow /*?*age_group=
Disallow /*?*price=
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_dir=
Disallow /*?amp=1*
Disallow /en/*?*calzado_tipo=
Disallow /en/*?*material_calzado=
Disallow /en/*?*fabricante_calzado=
Disallow /en/*?*color=
Disallow /en/*?*estilo=
Disallow /en/*?*catalogo=
Disallow /en/*?*gender=
Disallow /en/*?*age_group=
Disallow /en/*?*price=
Disallow /en/*?*product_list_mode=
Disallow /en/*?*product_list_order=
Disallow /en/*?*product_list_dir=
Disallow /en/*?amp=1*
Disallow /customer/
Disallow /checkout/
Disallow /sales/
Disallow /wishlist/
Disallow /review/
Disallow /productalert/
Disallow /rewards/
Disallow /stores/store/redirect
Disallow /en/customer/
Disallow /en/checkout/
Disallow /en/sales/
Disallow /en/wishlist/
Disallow /en/review/
Disallow /en/productalert/
Disallow /en/rewards/
Disallow /en/stores/store/redirect
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /elasticsuite/
Disallow /en/catalogsearch/
Disallow /en/catalog/product_compare/
Disallow /en/elasticsuite/
Disallow /index.php
Disallow /index.php/
Disallow /*.php$
Disallow /admin/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /pkginfo/
Disallow /pub/
Disallow /report/
Disallow /skin/
Disallow /static/
Disallow /var/
Disallow /en/index.php
Disallow /en/index.php/
Disallow /en/admin/
Disallow /en/app/
Disallow /en/bin/
Disallow /en/dev/
Disallow /en/lib/
Disallow /en/pkginfo/
Disallow /en/pub/
Disallow /en/report/
Disallow /en/skin/
Disallow /en/static/
Disallow /en/var/
Disallow /wp-admin/
Disallow /en/wp-admin/
Disallow /.git
Disallow /.svn
Disallow /.idea
Disallow /composer.json
Disallow /composer.lock
Back to top

Other Records

Field Value
sitemap https://calzafino.com/sitemap_calzado_es.xml
sitemap https://calzafino.com/sitemap_calzado_en.xml
Back to top

Comments

  • ============================================================
  • CalzaFino robots.txt (Magento source of truth)
  • Spanish store: /
  • English store: /en/
  • ============================================================
  • ============================================================
  • Content usage signal (advisory)
  • ============================================================
  • ============================================================
  • AI / training / scraping bots blocked (advisory + consistent)
  • ============================================================
  • ============================================================
  • Image bots (allow product/category images; block resize params)
  • ============================================================
  • ============================================================
  • Global rules for all bots
  • ============================================================
  • --- Sitemaps
  • --- Media: block most, allow what you want indexed
  • --- Pagination allowed (both store views)
  • --- Do NOT index API endpoints
  • --- Tracking/store/session params (avoid duplicate indexing)
  • --- Faceted navigation & sorting params
  • --- Customer/account/checkout (never index)
  • --- Search & internal endpoints
  • --- Technical / non-public paths
  • --- Common probing paths/files
Back to top

Warnings

  • `content-signal` is not a known field.
Back to top