Log In Sign Up

motocrosscenter.com
robots.txt

Robots Exclusion Standard data for motocrosscenter.com

Resource Scan

Scan Details

Site Domain motocrosscenter.com
Base Domain motocrosscenter.com
Scan Status Ok
Last Scan2024-10-25T09:44:39+00:00
Next Scan 2024-11-24T09:44:39+00:00

Last Scan

Scanned2024-10-25T09:44:39+00:00
URL https://motocrosscenter.com/robots.txt
Redirect https://www.motocrosscenter.com/robots.txt
Redirect Domain www.motocrosscenter.com
Redirect Base motocrosscenter.com
Domain IPs 104.26.6.164, 104.26.7.164, 172.67.68.254, 2606:4700:20::681a:6a4, 2606:4700:20::681a:7a4, 2606:4700:20::ac43:44fe
Redirect IPs 104.26.6.164, 104.26.7.164, 172.67.68.254, 2606:4700:20::681a:6a4, 2606:4700:20::681a:7a4, 2606:4700:20::ac43:44fe
Response IP 104.26.6.164
Found Yes
Hash 3932c5a134b12421ca7a446e86e1ffaf3170faea5c8706c826b0c3ac1a587836
SimHash be918130853d

Groups

*

Rule Path
Disallow /*orderby%3D
Disallow /*orderway%3D
Disallow /*tag%3D
Disallow /*id_currency%3D
Disallow /*search_query%3D
Disallow /*back%3D
Disallow /*n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-opc
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */classes/
Disallow */config/
Disallow */download/
Disallow */mails/
Disallow */modules/
Disallow */translations/
Disallow */tools/
Disallow /*es/direccion
Disallow /*es/direcciones
Disallow /*es/autenticacion
Disallow /*es/carro-de-la-compra
Disallow /*es/descuento
Disallow /*es/estado-pedido
Disallow /*es/historial-de-pedidos
Disallow /*es/identidad
Disallow /*es/mi-cuenta
Disallow /*es/carrito
Disallow /*es/confirmacion-pedido
Disallow /*es/devolucion-de-productos
Disallow /*es/pedido-rapido
Disallow /*es/vales
Disallow /*es/contrasena-olvidado
Disallow /*es/buscar
Disallow /*en/direccion
Disallow /*en/direcciones
Disallow /*en/autenticacion
Disallow /*en/carro-de-la-compra
Disallow /*en/descuento
Disallow /*en/estado-pedido
Disallow /*en/historial-de-pedidos
Disallow /*en/identidad
Disallow /*en/mi-cuenta
Disallow /*en/carrito
Disallow /*en/order-confirmation
Disallow /*en/devolucion-de-productos
Disallow /*en/pedido-rapido
Disallow /*en/vales
Disallow /*en/contrasena-olvidado
Disallow /*en/buscar
Disallow /*fr/direccion
Disallow /*fr/direcciones
Disallow /*fr/autenticacion
Disallow /*fr/carro-de-la-compra
Disallow /*fr/descuento
Disallow /*fr/estado-pedido
Disallow /*fr/historial-de-pedidos
Disallow /*fr/identidad
Disallow /*fr/mon-compte
Disallow /*fr/carrito
Disallow /*fr/confirmacion-pedido
Disallow /*fr/devolucion-de-productos
Disallow /*fr/pedido-rapido
Disallow /*fr/vales
Disallow /*fr/contrasena-olvidado
Disallow /*fr/buscar
Disallow /*pt/direccion
Disallow /*pt/direcciones
Disallow /*pt/autenticacion
Disallow /*pt/carro-de-la-compra
Disallow /*pt/descuento
Disallow /*pt/estado-pedido
Disallow /*pt/historial-de-pedidos
Disallow /*pt/identidad
Disallow /*pt/mi-cuenta
Disallow /*pt/carrito
Disallow /*pt/confirmacion-pedido
Disallow /*pt/devolucion-de-productos
Disallow /*pt/pedido-rapido
Disallow /*pt/vales
Disallow /*pt/contrasena-olvidado
Disallow /*pt/buscar
Disallow /shop/blog/author/*
Disallow /shop/blog/2010/*
Disallow /shop/blog/2011/*
Disallow /shop/blog/2012/*
Disallow /shop/blog/2013/*
Disallow /shop/blog/2014/*
Disallow /shop/blog/2015/*
Disallow /shop/blog/2016/*
Disallow /shop/blog/2017/*
Disallow /shop/blog/2018/*
Disallow /shop/blog/2019/*
Disallow /shop/blog/2020/*
Disallow /shop/blog/tag/*

baiduspider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

black hole

Rule Path
Disallow /

xenu\\\'s link sleuth 1.1c

Rule Path
Disallow /

xenu\\\'s

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Comments

  • robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • Private pages
  • Directories
  • Files
  • Blog
  • Tratamiento de User-agents específicos
Back to top