Log In Sign Up

modelismodeltren.com
robots.txt

Robots Exclusion Standard data for modelismodeltren.com

Resource Scan

Scan Details

Site Domain modelismodeltren.com
Base Domain modelismodeltren.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-08T12:30:19+00:00
Next Scan 2024-10-08T12:30:19+00:00

Last Successful Scan

Scanned2024-07-18T12:28:23+00:00
URL https://modelismodeltren.com/robots.txt
Redirect https://www.modelismodeltren.com/robots.txt
Redirect Domain www.modelismodeltren.com
Redirect Base modelismodeltren.com
Domain IPs 104.21.1.129, 172.67.129.66, 2606:4700:3033::6815:181, 2606:4700:3037::ac43:8142
Redirect IPs 104.21.1.129, 172.67.129.66, 2606:4700:3033::6815:181, 2606:4700:3037::ac43:8142
Response IP 104.21.1.129
Found Yes
Hash 389d4700e61a4d31c1764edf8875d5f53e18211bf58740d46d73c3d9b77c1805
SimHash b24cb1828110

Groups

yandex
dataforseobot
mj12bot
megaindex.ru
megaindex.com
ahrefsbot
petalbot
semrushbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
semrushbot-coub

Rule Path
Disallow /

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow /js/jquery/*
Disallow /temp/*
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow *.pdf$
Disallow /*?
Disallow /blog/*/feed/
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /es/app/
Disallow /es/cache/
Disallow /es/classes/
Disallow /es/config/
Disallow /es/controllers/
Disallow /es/download/
Disallow /es/js/
Disallow /es/localization/
Disallow /es/log/
Disallow /es/mails/
Disallow /es/modules/
Disallow /es/override/
Disallow /es/pdf/
Disallow /es/src/
Disallow /es/tools/
Disallow /es/translations/
Disallow /es/upload/
Disallow /es/var/
Disallow /es/vendor/
Disallow /es/webservice/
Disallow /*es/olvidaste-tu-contrasena
Disallow /*es/direccion
Disallow /*es/direcciones
Disallow /*es/autenticacion
Disallow /*es/carro-de-la-compra
Disallow /*es/descuento
Disallow /*es/historial-de-pedidos
Disallow /*es/identidad
Disallow /*es/mi-cuenta
Disallow /*es/devolucion-de-productos
Disallow /*es/vales
Disallow /*es/carrito
Disallow /*es/buscar
Disallow /*es/guest-tracking
Back to top

Other Records

Field Value
sitemap https://www.modelismodeltren.com/1_index_sitemap.xml
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • https://www.prestashop.com - https://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/robotstxt.html
  • Allow Directives
  • Private pages
  • Directories for www.modelismodeltren.com
  • Files
  • Sitemap
Back to top