Log In Sign Up

melga.lt
robots.txt

Robots Exclusion Standard data for melga.lt

Resource Scan

Scan Details

Site Domain melga.lt
Base Domain melga.lt
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-11T10:43:38+00:00
Next Scan 2026-03-12T10:43:38+00:00

Last Successful Scan

Scanned2025-10-20T09:14:34+00:00
URL https://melga.lt/robots.txt
Domain IPs 104.21.28.83, 172.67.170.108, 2606:4700:3030::6815:1c53, 2606:4700:3036::ac43:aa6c
Response IP 104.21.28.83
Found Yes
Hash 9d656f693a206197ec6e66fe6b10de9021521999649c270539c824bc6605420d
SimHash ba3e99098514

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow /modules/servicepages/uploads/*
Allow /modules/prcustombanners/images/*
Allow /modules/homeslider/images/*
Allow /modules/smartblog/images/*
Allow /modules/prproductmodel/img/*
Disallow /*?orderby=
Disallow /*?orderway=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26orderby%3D
Disallow /*%26orderway%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*?utm
Disallow /*?amp
Disallow /*?selected_filters=
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-opc
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */classes/
Disallow */config/
Disallow */download/
Disallow */mails/
Disallow */modules/
Disallow */translations/
Disallow */tools/
Disallow /*slaptazodio-atkurimas
Disallow /*address
Disallow /*addresses
Disallow /*prisijungimas
Disallow /*discount
Disallow /*uzsakymu-istorija
Disallow /*identity
Disallow /*profilis
Disallow /*order-follow
Disallow /*credit-slip
Disallow /*uzsakymas
Disallow /*search
Disallow /*quick-order
Disallow /*guest-tracking
Disallow /*uzsakymo-patvirtinimas
Back to top

Other Records

Field Value
sitemap https://melga.lt/1_index_sitemap.xml
Back to top

Comments

  • robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Allow Directives
  • Private pages
  • Directories
  • Files
  • Sitemap
Back to top