Log In Sign Up

eude.es
robots.txt

Robots Exclusion Standard data for eude.es

Resource Scan

Scan Details

Site Domain eude.es
Base Domain eude.es
Scan Status Ok
Last Scan2024-09-12T16:45:49+00:00
Next Scan 2024-10-12T16:45:49+00:00

Last Scan

Scanned2024-09-12T16:45:49+00:00
URL https://eude.es/robots.txt
Redirect https://www.eude.es/robots.txt
Redirect Domain www.eude.es
Redirect Base eude.es
Domain IPs 34.247.103.225, 54.154.225.98
Redirect IPs 34.247.103.225, 54.154.225.98
Response IP 54.154.225.98
Found Yes
Hash fa54a7a70e6ae983ec50ed79ab06e5e97a726649f29750d89f085aa65d82b9f9
SimHash 631471fbefc3

Groups

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

nutch

Rule Path
Disallow /

spock

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sbider/nutch

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

magent

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

huasai

Rule Path
Disallow /

datacha0s

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

atomic_email_hunter

Rule Path
Disallow /

mp3bot

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

betabot

Rule Path
Disallow /

core-project

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

java

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

wget

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

*

Rule Path
Allow /
Allow /wp-content/uploads
Allow /wp-content/uploads/
Allow /wp-content/plugins/
Allow /wp-content/themes/
Allow /wp-includes/js/
Allow /wp-admin/images/w-logo-blue.png
Disallow /wp-content/cache/
Disallow /anexosadmision/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /?ref=
Disallow /imagenes/
Disallow /wp-admin
Disallow /search
Disallow /*?s=
Disallow /feed
Disallow /comments/feed
Disallow /*/anexosadmision/
Disallow /*/trackback/
Disallow /*/attachment/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/anexosadmision/
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /author/
Disallow /category/*/page/
Disallow /category/*/feed/
Disallow /tags/*/page/
Disallow /tags/*/feed/
Disallow /page/
Disallow /comments
Disallow /xmlrpc.php
Disallow /contentHeader.php
Disallow /stats/
Disallow /AvisoLegal.html
Disallow /error.php
Disallow /*.swf$
Disallow /*.mp3$
Disallow /entrevistamos-marta-hernaez-profesora-de-eude-finanzas/
Disallow /profesor/marta-hernaez/
Disallow /masinfo/
Disallow /becas-icetex?
Disallow /respond.php?
Disallow /repair.php?
Disallow /outline.php?
Disallow /beer.php?
Disallow /delight.php?
Disallow /danger.php?
Disallow /confuse.php?
Disallow /confusion.php?
Disallow /board.php?
Disallow /step.php?
Disallow /*college-*
Disallow /*buy-*
Disallow /*best-*
Disallow /*how-to*
Disallow /*where-to*
Disallow /*homework*
Disallow /*help*
Disallow /*essay*
Disallow /*easay*
Disallow /*writ*
Disallow /*academic-*
Disallow /*-book-*
Disallow /*cheap*
Disallow /custom*
Disallow /*need-*
Disallow /*research*
Disallow /*do-my*
Disallow /*elrincon*
Disallow /*professional-*
Disallow /*website*
Disallow /*m%C3%A1ster-*
Disallow /*assignment*
Disallow /*accounting*
Disallow /*the-best-*
Disallow /*who-*
Disallow /*where-*
Disallow /*what-*
Disallow /*uk-*
Disallow /*university-*
Disallow /*thesis-*
Disallow /*thesis*
Disallow /*term-*
Disallow /*student-*
Disallow /*someone-*
Disallow /*purchase-*
Disallow /*scholarship*
Disallow /*report-writing-*
Disallow /*quality-*
Disallow /*the-best-*
Disallow /*pay-*
Disallow /*order-*
Disallow /*paper*
Disallow /*people-*
Disallow /*i-need-*
Disallow /*-how-*
Disallow /how-*
Disallow /*history-*
Disallow /*good-*
Disallow /farmacia/$
Disallow /*dissertation*
Disallow /*english*
Disallow /*buy*
Disallow /*-i-*
Disallow /*assignment*
Disallow /*ghost*
Disallow /*any*
Disallow /*writing*
Disallow /*write*
Disallow /*work*
Disallow /*examp*
Disallow /*economics*
Disallow /*speech*
Disallow /*paper*
Disallow /*should*
Disallow /*biology*
Disallow /*we-do*
Disallow /*chemistry*
Disallow /*for-me*
Disallow /*help*
Disallow /*letter*
Disallow /*service-*
Disallow /*lab-*
Disallow /*homework*
Disallow /*study*
Disallow /*writ*
Disallow /*farmacia*
Disallow /Contacto/*
Disallow /AvisoLegal.htm
Disallow /Podcast*
Disallow /speachs-*
Disallow /*for-sale*
Disallow /*dollars*
Disallow /*less*
Disallow /my-*
Disallow /*viagra*
Disallow /*obstacles*
Disallow /*overcoming*
Disallow /*destructors*
Disallow /*-my-*

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msiecrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

webcopier

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

httrack

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

microsoft.url.control

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

libwww

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.eude.es/sitemap.xml
Back to top

Comments

  • Crawlers that are kind enough to obey, but which we'd rather not have
  • unless they're feeding search engines.
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites or download them for offline viewing. Please obey robots.txt.
  • Sorry, wget in its recursive mode is a frequent problem.
  • Please read the man page and use it properly; there is a
  • --wait option you can use to set the delay between hits,
  • for instance.
  • A capture bot, downloads gazillions of pages with no public benefit
  • http://www.webreaper.net/
  • Poorly behaved Crawlers, some of these ignore
  • robots.txt but...
  • The 'grub' distributed client has been *very* poorly behaved.
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html
Back to top

Warnings

  • 4 invalid lines.
  • `noindex` is not a known field.
Back to top