Log In Sign Up

tutorialmonsters.com
robots.txt

Robots Exclusion Standard data for tutorialmonsters.com

Resource Scan

Scan Details

Site Domain tutorialmonsters.com
Base Domain tutorialmonsters.com
Scan Status Ok
Last Scan2024-10-09T05:54:03+00:00
Next Scan 2024-10-16T05:54:03+00:00

Last Scan

Scanned2024-10-09T05:54:03+00:00
URL https://tutorialmonsters.com/robots.txt
Domain IPs 2a00:1d70:c01c::68:91, 93.93.68.91
Response IP 93.93.68.91
Found Yes
Hash 6a20d555846cef78a37c498645a3b90ed3fd0ecb179e01111a067e4831892a49
SimHash f8138f190445

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /wp-
Disallow /?s=
Disallow /search
Allow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /prestashop/*orderby%3D
Disallow /prestashop/*orderway%3D
Disallow /prestashop/*tag%3D
Disallow /prestashop/*id_currency%3D
Disallow /prestashop/*search_query%3D
Disallow /prestashop/*id_lang%3D
Disallow /prestashop/*back%3D
Disallow /prestashop/*utm_source%3D
Disallow /prestashop/*utm_medium%3D
Disallow /prestashop/*utm_campaign%3D
Disallow /prestashop/*n%3D

*

Rule Path
Disallow /prestashop/classes/
Disallow /prestashop/config/
Disallow /prestashop/download/
Disallow /prestashop/mails/
Disallow /prestashop/modules/
Disallow /prestashop/translations/
Disallow /prestashop/tools/
Disallow /prestashop/addresses.php
Disallow /prestashop/address.php
Disallow /prestashop/authentication.php
Disallow /prestashop/cart.php
Disallow /prestashop/discount.php
Disallow /prestashop/footer.php
Disallow /prestashop/get-file.php
Disallow /prestashop/header.php
Disallow /prestashop/history.php
Disallow /prestashop/identity.php
Disallow /prestashop/images.inc.php
Disallow /prestashop/init.php
Disallow /prestashop/my-account.php
Disallow /prestashop/order.php
Disallow /prestashop/order-opc.php
Disallow /prestashop/order-slip.php
Disallow /prestashop/order-detail.php
Disallow /prestashop/order-follow.php
Disallow /prestashop/order-return.php
Disallow /prestashop/order-confirmation.php
Disallow /prestashop/pagination.php
Disallow /prestashop/password.php
Disallow /prestashop/pdf-invoice.php
Disallow /prestashop/pdf-order-return.php
Disallow /prestashop/pdf-order-slip.php
Disallow /prestashop/product-sort.php
Disallow /prestashop/search.php
Disallow /prestashop/statistics.php
Disallow /prestashop/attachment.php
Disallow /prestashop/guest-tracking.php
Disallow /prestashop/address
Disallow /prestashop/adresse
Disallow /prestashop/direccion
Disallow /prestashop/adresse
Disallow /prestashop/indirizzo
Disallow /prestashop/addresses
Disallow /prestashop/adresses
Disallow /prestashop/direcciones
Disallow /prestashop/adressen
Disallow /prestashop/indirizzi
Disallow /prestashop/authentication
Disallow /prestashop/authentification
Disallow /prestashop/autenticacion
Disallow /prestashop/authentifizierung
Disallow /prestashop/autenticazione
Disallow /prestashop/cart
Disallow /prestashop/panier
Disallow /prestashop/carro-de-la-compra
Disallow /prestashop/warenkorb
Disallow /prestashop/carrello
Disallow /prestashop/discount
Disallow /prestashop/bons-de-reduction
Disallow /prestashop/descuento
Disallow /prestashop/discount
Disallow /prestashop/sconto
Disallow /prestashop/guest-tracking
Disallow /prestashop/suivi-commande-invite
Disallow /prestashop/estado-pedido
Disallow /prestashop/auftragsverfolgung-gast
Disallow /prestashop/ospite-monitoraggio
Disallow /prestashop/order-history
Disallow /prestashop/historique-des-commandes
Disallow /prestashop/historial-de-pedidos
Disallow /prestashop/bestellungsverlauf
Disallow /prestashop/storico-ordine
Disallow /prestashop/identity
Disallow /prestashop/identite
Disallow /prestashop/identidad
Disallow /prestashop/kennung
Disallow /prestashop/identita
Disallow /prestashop/my-account
Disallow /prestashop/mon-compte
Disallow /prestashop/mi-cuenta
Disallow /prestashop/mein-Konto
Disallow /prestashop/il-mio-account
Disallow /prestashop/order
Disallow /prestashop/commande
Disallow /prestashop/carrito
Disallow /prestashop/bestellung
Disallow /prestashop/ordine
Disallow /prestashop/order-follow
Disallow /prestashop/details-de-la-commande
Disallow /prestashop/devolucion-de-productos
Disallow /prestashop/bestellungsverfolgung
Disallow /prestashop/seguito-ordine
Disallow /prestashop/quick-order
Disallow /prestashop/commande-rapide
Disallow /prestashop/pedido-rapido
Disallow /prestashop/schnell-bestellung
Disallow /prestashop/ordine-veloce
Disallow /prestashop/order-slip
Disallow /prestashop/avoirs
Disallow /prestashop/vales
Disallow /prestashop/bestellschein
Disallow /prestashop/nota-di-ordine
Disallow /prestashop/password-recovery
Disallow /prestashop/mot-de-passe-oublie
Disallow /prestashop/contrasena-olvidado
Disallow /prestashop/kennwort-wiederherstellung
Disallow /prestashop/password-recupero
Disallow /prestashop/search
Disallow /prestashop/recherche
Disallow /prestashop/buscar
Disallow /prestashop/suche
Disallow /prestashop/cerca
Back to top

Comments

  • Primero el contenido adjunto.
  • También podemos desindexar todo lo que empiece
  • por wp-. Es lo mismo que los Disallow de arriba pero
  • incluye cosas como wp-rss.php
  • Sitemap permitido, búsquedas no.
  • Sitemap: http://tutorialmonsters.com/sitemap.xml
  • Permitimos el feed general para Google Blogsearch.
  • Impedimos que permalink/feed/ sea indexado ya que el
  • feed con los comentarios suele posicionarse en lugar de
  • la entrada y desorienta a los usuarios.
  • Lo mismo con URLs terminadas en /trackback/ que sólo
  • sirven como Trackback URI (y son contenido duplicado).
  • A partir de aquí es opcional pero recomendado.
  • Lista de bots que suelen respetar el robots.txt pero rara
  • vez hacen un buen uso del sitio y abusan bastante
  • Añadir al gusto del consumidor
  • Slurp (Yahoo!), Noxtrum y el bot de MSN a veces tienen
  • idas de pinza, toca decirles que reduzcan la marcha.
  • El valor es en segundos y podéis dejarlo bajo e ir
  • subiendo hasta el punto óptimo.
  • robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • GoogleBot specific
  • All bots
  • Directories
  • Files
  • Sitemap
Back to top