Log In Sign Up

santinicycling.com
robots.txt

Robots Exclusion Standard data for santinicycling.com

Resource Scan

Scan Details

Site Domain santinicycling.com
Base Domain santinicycling.com
Scan Status Ok
Last Scan2024-11-07T10:09:27+00:00
Next Scan 2024-12-07T10:09:27+00:00

Last Scan

Scanned2024-11-07T10:09:27+00:00
URL https://santinicycling.com/robots.txt
Redirect https://www.santinicycling.com/robots.txt
Redirect Domain www.santinicycling.com
Redirect Base santinicycling.com
Domain IPs 52.178.114.226
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash c9d575d6efe33bf1a7c48ccb8b4a3c59e9d5f44229c578617e09de46294b72ad
SimHash 700ed85825bc

Groups

awariorssbot
awariosmartbot
mj12bot
dotbot

Rule Path
Disallow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mozilla/5.0 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /*it/indirizzo
Disallow /*it/indirizzi
Disallow /*it/login
Disallow /*it/carrello
Disallow /*it/buoni-sconto
Disallow /*it/tracciatura-ospite
Disallow /*it/cronologia-ordini
Disallow /*it/dati-personali
Disallow /*it/account
Disallow /*it/ordine
Disallow /*it/conferma-ordine
Disallow /*it/segui-ordine
Disallow /*it/buono-ordine
Disallow /*it/recupero-password
Disallow /*it/ricerca
Disallow /*en/address
Disallow /*en/addresses
Disallow /*en/login
Disallow /*en/cart
Disallow /*en/discount
Disallow /*en/guest-tracking
Disallow /*en/order-history
Disallow /*en/identity
Disallow /*en/my-account
Disallow /*en/order
Disallow /*en/order-confirmation
Disallow /*en/order-follow
Disallow /*en/credit-slip
Disallow /*en/password-recovery
Disallow /*en/search
Disallow /*fr/adresse
Disallow /*fr/adresses
Disallow /*fr/connexion
Disallow /*fr/panier
Disallow /*fr/reduction
Disallow /*fr/suivi-commande-invite
Disallow /*fr/historique-commandes
Disallow /*fr/identite
Disallow /*fr/mon-compte
Disallow /*fr/commande
Disallow /*fr/confirmation-commande
Disallow /*fr/suivi-commande
Disallow /*fr/avoirs
Disallow /*fr/recuperation-mot-de-passe
Disallow /*fr/recherche
Disallow /*us/address
Disallow /*us/addresses
Disallow /*us/login
Disallow /*us/cart
Disallow /*us/discount
Disallow /*us/guest-tracking
Disallow /*us/order-history
Disallow /*us/identity
Disallow /*us/my-account
Disallow /*us/order
Disallow /*us/order-confirmation
Disallow /*us/order-follow
Disallow /*us/credit-slip
Disallow /*us/password-recovery
Disallow /*us/search
Allow */modules/*.css
Allow */modules/*.woff
Allow */modules/*.woff2
Allow */modules/*.ttf
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow /js/jquery/*
Allow /modules/gsnippetsreviews/views/fonts/fontawesome-webfont.ttf?v=4.3.0
Allow /modules/gsnippetsreviews/views/fonts/fontawesome-webfont.woff2?v=4.3.0
Allow /modules/gsnippetsreviews/views/fonts/fontawesome-webfont.woff?v=4.3.0
Allow /modules/ybc_instagram/views/fonts/fontawesome-webfont.ttf?v=4.7.0
Allow /modules/ybc_instagram/views/fonts/fontawesome-webfont.woff2?v=4.7.0
Allow /modules/ybc_instagram/views/fonts/fontawesome-webfont.woff?v=4.7.0
Back to top

Other Records

Field Value
sitemap https://www.santinicycling.com/sitemap.xml
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Private pages
  • Directories
  • Files
  • Allow Directives
Back to top