epidemiologiamolecular.com
robots.txt

Robots Exclusion Standard data for epidemiologiamolecular.com

Resource Scan

Scan Details

Site Domain epidemiologiamolecular.com
Base Domain epidemiologiamolecular.com
Scan Status Ok
Last Scan2024-10-06T03:12:31+00:00
Next Scan 2024-10-13T03:12:31+00:00

Last Scan

Scanned2024-10-06T03:12:31+00:00
URL https://epidemiologiamolecular.com/robots.txt
Domain IPs 173.254.30.113
Response IP 173.254.30.113
Found Yes
Hash 3a75b87810d0bc2acc162f5b177bffdd244abb440e0e046ef10c3cdeab7e50c1
SimHash 514a5cc009bb

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /.css$
Allow /.js$
Disallow /wp-admin
Disallow /wp-login
Disallow /wp-includes/
Disallow /*/feed/
Disallow /*/attachment/
Disallow *?replytocom
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /*?s=
Disallow /search/
Disallow /*/*/*/feed.xml
Disallow /?attachment_id*
Disallow /archives/tag/
Disallow /cgi-bin

*

Rule Path
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$

mediapartners-google *

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

link sleuth 1.1c de xenu

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

bot de archive.org

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

gigablast spider

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

picscout

Rule Path
Disallow /

blexbot crawler

Rule Path
Disallow /

tineye

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot / 2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

netestate ne crawler (+ http: //www.website-datenbank.de/)

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pi-monster

Rule Path
Disallow /

eccp / 1.0 ([correo electrónico protegido])

Rule Path
Disallow /

psbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

zbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

simplepie

Rule Path
Disallow /

wget

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

cuantificar

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

cuam

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://epidemiologiamolecular.com/sitemap_index.xml

Comments

  • Bloqueo de trackbacks
  • No rastrear copias de seguridad
  • Reglas para bots conocidos
  • Bloquear NextGenSearchBot
  • Bloquear ia-archiver del sitio de rastreo
  • Bloquear archive.org_bot del sitio de rastreo
  • Bloquear el bot de Archive.org del sitio de rastreo
  • Bloquear LinkWalker del sitio de rastreo
  • Bloquear GigaBlast Spider del sitio de rastreo
  • Bloquear ia_archiver-web.archive.org_bot del sitio de rastreo
  • Bloquear PicScout Crawler del sitio de rastreo
  • Bloquear el rastreador BLEXBot del sitio de rastreo
  • Bloquear TinEye del sitio de rastreo
  • Bloquear SEOkicks
  • Bloquear BlexBot
  • Bloquear SISTRIX
  • Robot de tiempo de actividad del bloque
  • Robot Ezooms de bloque
  • Bloquear netEstate NE Crawler (+ http: //www.website-datenbank.de/)
  • Block Robot WiseGuys
  • Bloque Turnitin Robot
  • Bloque Heritrix
  • Block pricepi
  • Bloquear Eniro
  • Bloquear Psbot
  • Bloquear Youdao
  • BLEXBot
  • Bloquear NaverBot
  • Bloquear ZBot
  • Block Vagabondo
  • Bloquear LinkWalker
  • Block SimplePie
  • Bloquear Wget
  • Block Pixray-Seeker
  • Block BoardReader
  • Cuantificar en bloque
  • Bloque Plukkie
  • Bloque Cuam
  • https://megaindex.com/crawler

Warnings

  • 2 invalid lines.