bikezona.com
robots.txt

Robots Exclusion Standard data for bikezona.com

Resource Scan

Scan Details

Site Domain bikezona.com
Base Domain bikezona.com
Scan Status Ok
Last Scan2024-06-26T10:05:46+00:00
Next Scan 2024-07-03T10:05:46+00:00

Last Scan

Scanned2024-06-26T10:05:46+00:00
URL https://bikezona.com/robots.txt
Redirect https://www.bikezona.com/robots.txt
Redirect Domain www.bikezona.com
Redirect Base bikezona.com
Domain IPs 46.105.107.84
Redirect IPs 46.105.107.84
Response IP 46.105.107.84
Found Yes
Hash a7ed597ba32391d061fb90b3e7d98e35760be8a206a0496193f23615b723c86f
SimHash 231ffc8046e0

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow /bbr/
Disallow /test/
Disallow /fotomaton/
Disallow /equipobz/
Disallow /equipodh/
Disallow /foldinglife/
Disallow /alimentacion/
Disallow /materiales/
Disallow /museo/
Disallow /gadget/
Disallow /novedades/
Disallow /descargas/
Disallow /planetabike/
Disallow /dh/
Disallow /bike-trial/
Disallow /mtb/
Disallow /cicloturismo/
Disallow /doctor/
Disallow /fisico/
Disallow /legal/
Disallow /manitas/
Disallow /uciprotour/
Disallow /mercadillo/
Disallow /privados/
Disallow /bicicletas-segundamano/
Disallow /perfil/
Disallow /publicidad/
Disallow /info/
Disallow /misimagenes/
Disallow /util/

Comments

  • Para retrasar los bots de MSN y bloquear otros