Log In Sign Up

gank.mx
robots.txt

Robots Exclusion Standard data for gank.mx

Resource Scan

Scan Details

Site Domain gank.mx
Base Domain gank.mx
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-07T14:35:07+00:00
Next Scan 2026-01-08T14:35:07+00:00

Last Successful Scan

Scanned2025-12-08T14:35:00+00:00
URL https://gank.mx/robots.txt
Domain IPs 2a02:4780:84:2a3a:36e1:8038:9cbb:67f5, 2a02:4780:84:b608:1cec:7673:3a0d:e90e, 84.32.84.172, 84.32.84.245
Response IP 93.127.196.96
Found Yes
Hash 1e788d65acd617b8380f20aaf6c8cc1c2afc2647b75f4df2ec3b9b6b04f527e0
SimHash aa006b0b013c

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow */modules/*.gif
Allow */modules/*.svg
Allow */modules/*.webp
Allow */modules/*.avif
Allow /js/jquery/*
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*?q=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*%26q%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dregistration
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow /en/app/
Disallow /en/cache/
Disallow /en/classes/
Disallow /en/config/
Disallow /en/controllers/
Disallow /en/download/
Disallow /en/js/
Disallow /en/localization/
Disallow /en/log/
Disallow /en/mails/
Disallow /en/modules/
Disallow /en/override/
Disallow /en/pdf/
Disallow /en/src/
Disallow /en/tools/
Disallow /en/translations/
Disallow /en/upload/
Disallow /en/var/
Disallow /en/vendor/
Disallow /en/webservice/
Disallow /mx/app/
Disallow /mx/cache/
Disallow /mx/classes/
Disallow /mx/config/
Disallow /mx/controllers/
Disallow /mx/download/
Disallow /mx/js/
Disallow /mx/localization/
Disallow /mx/log/
Disallow /mx/mails/
Disallow /mx/modules/
Disallow /mx/override/
Disallow /mx/pdf/
Disallow /mx/src/
Disallow /mx/tools/
Disallow /mx/translations/
Disallow /mx/upload/
Disallow /mx/var/
Disallow /mx/vendor/
Disallow /mx/webservice/
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /en/address
Disallow /address
Disallow /en/addresses
Disallow /addresses
Disallow /en/login
Disallow /login
Disallow /en/cart
Disallow /cart
Disallow /en/discount
Disallow /discount
Disallow /en/guest-tracking
Disallow /guest-tracking
Disallow /en/order-history
Disallow /order-history
Disallow /en/identity
Disallow /identity
Disallow /en/my-account
Disallow /my-account
Disallow /en/order
Disallow /order
Disallow /en/order-confirmation
Disallow /order-confirmation
Disallow /en/order-follow
Disallow /order-follow
Disallow /en/credit-slip
Disallow /credit-slip
Disallow /en/password-recovery
Disallow /password-recovery
Disallow /en/registration
Disallow /registration
Disallow /en/search
Disallow /search
Disallow /mx/direccion
Disallow /mx/direcciones
Disallow /mx/iniciar-sesion
Disallow /mx/carrito
Disallow /mx/descuento
Disallow /mx/seguimiento-pedido-invitado
Disallow /mx/historial-compra
Disallow /mx/datos-personales
Disallow /mx/mi-cuenta
Disallow /mx/confirmacion-pedido
Disallow /mx/seguimiento-pedido
Disallow /mx/nota-credito
Disallow /mx/recuperar-contrasena
Disallow /mx/registro
Disallow /mx/busqueda
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • https://www.prestashop-project.org
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/robotstxt.html
  • Allow directives for modules
  • Non-friendly URLs and parameters blocked from crawling
  • Rules for /
  • Directories blocked from crawling
  • Friendly URLs blocked from crawling
Back to top

Warnings

  • 1 invalid line.
Back to top