Log In Sign Up

epdata.es
robots.txt

Robots Exclusion Standard data for epdata.es

Resource Scan

Scan Details

Site Domain epdata.es
Base Domain epdata.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-28T21:11:15+00:00
Next Scan 2024-06-26T21:11:15+00:00

Last Successful Scan

Scanned2023-11-30T20:25:12+00:00
URL https://epdata.es/robots.txt
Redirect https://www.epdata.es/robots.txt
Redirect Domain www.epdata.es
Redirect Base epdata.es
Domain IPs 2600:9000:269a:1400:1e:31bf:1100:93a1, 2600:9000:269a:200:1e:31bf:1100:93a1, 2600:9000:269a:6400:1e:31bf:1100:93a1, 2600:9000:269a:9400:1e:31bf:1100:93a1, 2600:9000:269a:9a00:1e:31bf:1100:93a1, 2600:9000:269a:ba00:1e:31bf:1100:93a1, 2600:9000:269a:c600:1e:31bf:1100:93a1, 2600:9000:269a:dc00:1e:31bf:1100:93a1, 3.160.188.21, 3.160.188.46, 3.160.188.50, 3.160.188.73
Redirect IPs 18.66.196.11, 18.66.196.52, 18.66.196.76, 18.66.196.92, 2600:9000:269a:4c00:1e:31bf:1100:93a1, 2600:9000:269a:6000:1e:31bf:1100:93a1, 2600:9000:269a:600:1e:31bf:1100:93a1, 2600:9000:269a:8200:1e:31bf:1100:93a1, 2600:9000:269a:8a00:1e:31bf:1100:93a1, 2600:9000:269a:a600:1e:31bf:1100:93a1, 2600:9000:269a:c00:1e:31bf:1100:93a1, 2600:9000:269a:f000:1e:31bf:1100:93a1
Response IP 18.245.86.88
Found Yes
Hash 15de5c4b8daf6f1328308fc0d79a3db828bac5543bc71a0172b6707ca1b29303
SimHash a31775c289f6

Groups

*

Rule Path
Disallow /admin/
Disallow /mi-cuenta/
Allow .js
Allow .css

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yahoo ad monitoring

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

fetch

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

discobot

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

dloader

Rule Path
Disallow /

dloader(naverrobot)

Rule Path
Disallow /

doc

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

genieo

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

kimengi

Rule Path
Disallow /

lexxebot/1.0

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

metauri

Rule Path
Disallow /

moreover

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

nabot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

netseer crawler

Rule Path
Disallow /

newscan

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

umbot-ln

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

universalfeedparser

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

wget

Rule Path
Disallow /

wotbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yasni

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.epdata.es/sitemap/index
Back to top

Comments

  • bloqueamos.ini
  • crawlers y bots que rastrean la web.ini
  • crawlers y bots que rastrean la web.fin
  • crawlers y bots poco útiles.ini
  • crawlers y bots poco útiles.ini
  • agentes nocivos conocidos.ini
  • agentes nocivos conocidos.fin
  • bloqueamos.fin
Back to top