Log In Sign Up

beastybike.com
robots.txt

Robots Exclusion Standard data for beastybike.com

Resource Scan

Scan Details

Site Domain beastybike.com
Base Domain beastybike.com
Scan Status Ok
Last Scan2024-05-18T02:14:27+00:00
Next Scan 2024-06-17T02:14:27+00:00

Last Scan

Scanned2024-05-18T02:14:27+00:00
URL https://beastybike.com/robots.txt
Redirect https://www.beastybike.com/robots.txt
Redirect Domain www.beastybike.com
Redirect Base beastybike.com
Domain IPs 104.26.12.164, 104.26.13.164, 172.67.71.101, 2606:4700:20::681a:ca4, 2606:4700:20::681a:da4, 2606:4700:20::ac43:4765
Redirect IPs 104.26.12.164, 104.26.13.164, 172.67.71.101, 2606:4700:20::681a:ca4, 2606:4700:20::681a:da4, 2606:4700:20::ac43:4765
Response IP 104.26.13.164
Found Yes
Hash d47a1a27b2fe88c16cac12a1d5040650406b5beaef82e881e5c3b39881044ba1
SimHash 801c392b0535

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow /js/jquery/*
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /fr/app/
Disallow /fr/cache/
Disallow /fr/classes/
Disallow /fr/config/
Disallow /fr/controllers/
Disallow /fr/download/
Disallow /fr/js/
Disallow /fr/localization/
Disallow /fr/log/
Disallow /fr/mails/
Disallow /fr/modules/
Disallow /fr/override/
Disallow /fr/pdf/
Disallow /fr/src/
Disallow /fr/tools/
Disallow /fr/translations/
Disallow /fr/upload/
Disallow /fr/var/
Disallow /fr/vendor/
Disallow /fr/webservice/
Disallow /gb/app/
Disallow /gb/cache/
Disallow /gb/classes/
Disallow /gb/config/
Disallow /gb/controllers/
Disallow /gb/download/
Disallow /gb/js/
Disallow /gb/localization/
Disallow /gb/log/
Disallow /gb/mails/
Disallow /gb/modules/
Disallow /gb/override/
Disallow /gb/pdf/
Disallow /gb/src/
Disallow /gb/tools/
Disallow /gb/translations/
Disallow /gb/upload/
Disallow /gb/var/
Disallow /gb/vendor/
Disallow /gb/webservice/
Disallow /nl/app/
Disallow /nl/cache/
Disallow /nl/classes/
Disallow /nl/config/
Disallow /nl/controllers/
Disallow /nl/download/
Disallow /nl/js/
Disallow /nl/localization/
Disallow /nl/log/
Disallow /nl/mails/
Disallow /nl/modules/
Disallow /nl/override/
Disallow /nl/pdf/
Disallow /nl/src/
Disallow /nl/tools/
Disallow /nl/translations/
Disallow /nl/upload/
Disallow /nl/var/
Disallow /nl/vendor/
Disallow /nl/webservice/
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /fr/app/
Disallow /fr/cache/
Disallow /fr/classes/
Disallow /fr/config/
Disallow /fr/controllers/
Disallow /fr/download/
Disallow /fr/js/
Disallow /fr/localization/
Disallow /fr/log/
Disallow /fr/mails/
Disallow /fr/modules/
Disallow /fr/override/
Disallow /fr/pdf/
Disallow /fr/src/
Disallow /fr/tools/
Disallow /fr/translations/
Disallow /fr/upload/
Disallow /fr/var/
Disallow /fr/vendor/
Disallow /fr/webservice/
Disallow /gb/app/
Disallow /gb/cache/
Disallow /gb/classes/
Disallow /gb/config/
Disallow /gb/controllers/
Disallow /gb/download/
Disallow /gb/js/
Disallow /gb/localization/
Disallow /gb/log/
Disallow /gb/mails/
Disallow /gb/modules/
Disallow /gb/override/
Disallow /gb/pdf/
Disallow /gb/src/
Disallow /gb/tools/
Disallow /gb/translations/
Disallow /gb/upload/
Disallow /gb/var/
Disallow /gb/vendor/
Disallow /gb/webservice/
Disallow /nl/app/
Disallow /nl/cache/
Disallow /nl/classes/
Disallow /nl/config/
Disallow /nl/controllers/
Disallow /nl/download/
Disallow /nl/js/
Disallow /nl/localization/
Disallow /nl/log/
Disallow /nl/mails/
Disallow /nl/modules/
Disallow /nl/override/
Disallow /nl/pdf/
Disallow /nl/src/
Disallow /nl/tools/
Disallow /nl/translations/
Disallow /nl/upload/
Disallow /nl/var/
Disallow /nl/vendor/
Disallow /nl/webservice/
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /fr/app/
Disallow /fr/cache/
Disallow /fr/classes/
Disallow /fr/config/
Disallow /fr/controllers/
Disallow /fr/download/
Disallow /fr/js/
Disallow /fr/localization/
Disallow /fr/log/
Disallow /fr/mails/
Disallow /fr/modules/
Disallow /fr/override/
Disallow /fr/pdf/
Disallow /fr/src/
Disallow /fr/tools/
Disallow /fr/translations/
Disallow /fr/upload/
Disallow /fr/var/
Disallow /fr/vendor/
Disallow /fr/webservice/
Disallow /gb/app/
Disallow /gb/cache/
Disallow /gb/classes/
Disallow /gb/config/
Disallow /gb/controllers/
Disallow /gb/download/
Disallow /gb/js/
Disallow /gb/localization/
Disallow /gb/log/
Disallow /gb/mails/
Disallow /gb/modules/
Disallow /gb/override/
Disallow /gb/pdf/
Disallow /gb/src/
Disallow /gb/tools/
Disallow /gb/translations/
Disallow /gb/upload/
Disallow /gb/var/
Disallow /gb/vendor/
Disallow /gb/webservice/
Disallow /nl/app/
Disallow /nl/cache/
Disallow /nl/classes/
Disallow /nl/config/
Disallow /nl/controllers/
Disallow /nl/download/
Disallow /nl/js/
Disallow /nl/localization/
Disallow /nl/log/
Disallow /nl/mails/
Disallow /nl/modules/
Disallow /nl/override/
Disallow /nl/pdf/
Disallow /nl/src/
Disallow /nl/tools/
Disallow /nl/translations/
Disallow /nl/upload/
Disallow /nl/var/
Disallow /nl/vendor/
Disallow /nl/webservice/
Disallow /*fr/adresse
Disallow /*fr/adresses
Disallow /*fr/authentification
Disallow /*fr/panier
Disallow /*fr/bons-de-reduction
Disallow /*fr/suivi-commande-invite
Disallow /*fr/historique-des-commandes
Disallow /*fr/identite
Disallow /*fr/mon-compte
Disallow /*fr/commande
Disallow /*fr/details-de-la-commande
Disallow /*fr/avoirs
Disallow /*fr/mot-de-passe-oublie
Disallow /*fr/recherche
Disallow /*gb/address
Disallow /*gb/addresses
Disallow /*gb/authentication
Disallow /*gb/cart
Disallow /*gb/discount
Disallow /*gb/guest-tracking
Disallow /*gb/order-history
Disallow /*gb/identity
Disallow /*gb/my-account
Disallow /*gb/order
Disallow /*gb/order-follow
Disallow /*gb/order-slip
Disallow /*gb/password-recovery
Disallow /*gb/search
Disallow /*nl/adres
Disallow /*nl/adresse
Disallow /*nl/adressen
Disallow /*nl/adresses
Disallow /*nl/authentification
Disallow /*nl/vertificatie
Disallow /*nl/winkelmandje
Disallow /*nl/panier
Disallow /*nl/winkelwagen
Disallow /*nl/bons-de-reduction
Disallow /*nl/kortingsbonnen
Disallow /*nl/bestelling-volgen-als-gast
Disallow /*nl/suivi-commande-invite
Disallow /*nl/bestelling-volgen
Disallow /*nl/historique-des-commandes
Disallow /*nl/opdrachtgeschiedenis
Disallow /*nl/identiteit
Disallow /*nl/identite
Disallow /*nl/mijn-account
Disallow /*nl/mon-compte
Disallow /*nl/bestelling
Disallow /*nl/commande
Disallow /*nl/opdracht
Disallow /*nl/details-de-la-commande
Disallow /*nl/bestelingsgegevens
Disallow /*nl/bestel-bon
Disallow /*nl/avoirs
Disallow /*nl/activa
Disallow /*nl/mot-de-passe-oublie
Disallow /*nl/wachtwoord-vergeten
Disallow /*nl/zoeken
Disallow /*nl/recherche
Disallow /*nl/zoek
Back to top

Other Records

Field Value
sitemap https://www.beastybike.com/1_index_sitemap.xml
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Allow Directives
  • Private pages
  • Directories for www.beastybike.com
  • Directories for www.beastybike.eu
  • Directories for www.beastybike.nl
  • Files
  • Sitemap
Back to top