Log In Sign Up

rukodelki.com.ua
robots.txt

Robots Exclusion Standard data for rukodelki.com.ua

Resource Scan

Scan Details

Site Domain rukodelki.com.ua
Base Domain rukodelki.com.ua
Scan Status Ok
Last Scan2024-06-12T17:00:08+00:00
Next Scan 2024-07-12T17:00:08+00:00

Last Scan

Scanned2024-06-12T17:00:08+00:00
URL https://rukodelki.com.ua/robots.txt
Domain IPs 104.21.6.192, 172.67.135.50, 2606:4700:3034::6815:6c0, 2606:4700:3035::ac43:8732
Response IP 172.67.135.50
Found Yes
Hash 0c7575caa8e541e961f5828ea4c558835178fb01e8e5fcac3b93d8d032cbc8f9
SimHash fab8f9098514

Groups

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow /do-not-crawl/ disallow this directory

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Disallow /*?orderby=
Disallow /*?orderway=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26orderby%3D
Disallow /*%26orderway%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-opc
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */classes/
Disallow */config/
Disallow */download/
Disallow */mails/
Disallow */modules/
Disallow */translations/
Disallow */tools/
Disallow /*ru/address
Disallow /*ru/address
Disallow /*ru/addresses
Disallow /*ru/addresses
Disallow /*ru/authentication
Disallow /*ru/authentication
Disallow /*ru/cart
Disallow /*ru/cart
Disallow /*ru/discount
Disallow /*ru/discount
Disallow /*ru/guest-tracking
Disallow /*ru/guest-tracking
Disallow /*ru/order-history
Disallow /*ru/order-history
Disallow /*ru/identity
Disallow /*ru/identity
Disallow /*ru/my-account
Disallow /*ru/my-account
Disallow /*ru/order
Disallow /*ru/order
Disallow /*ru/
Disallow /*ru/order-follow
Disallow /*ru/order-follow
Disallow /*ru/quick-order
Disallow /*ru/quick-order
Disallow /*ru/order-slip
Disallow /*ru/order-slip
Disallow /*ru/password-recovery
Disallow /*ru/password-recovery
Disallow /*ru/search
Disallow /*ru/search
Disallow /*uk/address
Disallow /*uk/address
Disallow /*uk/addresses
Disallow /*uk/addresses
Disallow /*uk/authentication
Disallow /*uk/authentication
Disallow /*uk/cart
Disallow /*uk/cart
Disallow /*uk/discount
Disallow /*uk/discount
Disallow /*uk/guest-tracking
Disallow /*uk/guest-tracking
Disallow /*uk/order-history
Disallow /*uk/order-history
Disallow /*uk/identity
Disallow /*uk/identity
Disallow /*uk/my-account
Disallow /*uk/my-account
Disallow /*uk/order
Disallow /*uk/order
Disallow /*uk/order-follow
Disallow /*uk/order-follow
Disallow /*uk/quick-order
Disallow /*uk/quick-order
Disallow /*uk/order-slip
Disallow /*uk/order-slip
Disallow /*uk/password-recovery
Disallow /*uk/password-recovery
Disallow /*uk/search
Disallow /*uk/search
Back to top

Other Records

Field Value
sitemap https://rukodelki.com.ua/1_index_sitemap.xml
Back to top

Comments

  • robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Disable amazon bots
  • Allow Directives
  • Private pages
  • Directories
  • Files
  • Sitemap
Back to top