Log In Sign Up

ferreidea.com
robots.txt

Robots Exclusion Standard data for ferreidea.com

Resource Scan

Scan Details

Site Domain ferreidea.com
Base Domain ferreidea.com
Scan Status Ok
Last Scan2025-10-26T07:09:08+00:00
Next Scan 2025-11-25T07:09:08+00:00

Last Scan

Scanned2025-10-26T07:09:08+00:00
URL https://ferreidea.com/robots.txt
Domain IPs 178.33.167.147
Response IP 178.33.167.147
Found Yes
Hash 5f9f4ba4eac74b84e4b31daa24094e8c7560189012fb314ce471000c5853f801
SimHash 78f47b08241c

Groups

*

Rule Path
Allow /*.css$
Allow /*.js$
Allow /*.mjs$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$
Allow /*.svg$
Allow /*.ico$
Allow /*.woff$
Allow /*.woff2$
Allow /*.ttf$
Allow /*.eot$
Allow /themes/
Allow /assets/
Allow /modules/*/views/css/
Allow /modules/*/views/js/
Allow /modules/*/views/img/
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /modules/
Disallow /iniciar-sesion
Disallow /mi-cuenta
Disallow /carrito
Disallow /pedido
Disallow /confirmacion-pedido
Disallow /seguimiento-pedido
Disallow /seguimiento-pedido-invitado
Disallow /historial-compra
Disallow /datos-personales
Disallow /direccion
Disallow /direcciones
Disallow /descuento
Disallow /facturas-abono
Disallow /recuperar-contrase%C3%83%C2%B1a
Disallow /busqueda
Disallow /login
Disallow /my-account
Disallow /cart
Disallow /order
Disallow /order-confirmation
Disallow /search
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?orderby=
Disallow /*%26orderby%3D
Disallow /*?n=
Disallow /*%26n%3D
Disallow /*?page=
Disallow /*%26page%3D
Disallow /*?id_currency=
Disallow /*%26id_currency%3D
Disallow /*?search_query=
Disallow /*%26search_query%3D
Disallow /*?q=
Disallow /*%26q%3D
Disallow /*?back=
Disallow /*%26back%3D
Disallow /*?utm_
Disallow /*%26utm_
Disallow /*?gclid=
Disallow /*%26gclid%3D
Disallow /*?fbclid=
Disallow /*%26fbclid%3D
Disallow /*?*token=
Disallow /*%26*token%3D

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

storebot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

claude-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

ccbot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

seobilitybot

Rule Path
Disallow /

sergiobot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

headlesschrome

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

gptbot-image

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://ferreidea.com/index.php?fc=module&module=lgsitemaps&controller=sitemap&name=sitemap_1
sitemap https://ferreidea.com/index.php?fc=module&module=lgsitemaps&controller=sitemap&name=product_1_1
sitemap https://ferreidea.com/index.php?fc=module&module=lgsitemaps&controller=sitemap&name=category_1_1
sitemap https://ferreidea.com/index.php?fc=module&module=lgsitemaps&controller=sitemap&name=cms_1_1
sitemap https://ferreidea.com/index.php?fc=module&module=lgsitemaps&controller=sitemap&name=manufacturer_1_1
sitemap https://ferreidea.com/module/ultimateimagetool/sitemap?token=8b40c32e203a16556cbd4bedeabd1da6
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • --- SITEMAPS ---
  • ----------------------------------------------------------
  • REGLAS GENERALES (todos los bots)
  • ----------------------------------------------------------
  • Permitir recursos para renderizado (mejor comprensión de producto/contenido)
  • Permitir assets dentro de módulos (pero bloqueamos el resto del árbol más abajo)
  • --- ZONAS INTERNAS / DIRECTORIOS SISTEMA (PrestaShop 8.1) ---
  • (Bloqueo general de módulos; arriba permitimos sus assets necesarios)
  • --- RUTAS PRIVADAS / SIN VALOR SEO (friendly URLs comunes) ---
  • (Variantes EN por si existieran)
  • --- CONTROLADORES por parámetro (evitar indexación de flujos internos) ---
  • --- PARÁMETROS que generan duplicados (ahorro de crawl budget) ---
  • Ordenación, paginaciones, búsquedas y tracking
  • ----------------------------------------------------------
  • LLM & SEARCH BOTS — PERMITIDOS EXPLÍCITAMENTE
  • (No es requerido, pero lo dejamos claro y arriba ya quedó todo Allow por defecto)
  • ----------------------------------------------------------
  • ----------------------------------------------------------
  • BLOQUEO DE SCRAPERS / TRACKERS CONOCIDOS
  • (Lista viva; muchos respetan robots.txt, otros no. Complementa con WAF/CDN e IP rate-limits.)
  • ----------------------------------------------------------
Back to top