cordopolis.eldiario.es
robots.txt

Robots Exclusion Standard data for cordopolis.eldiario.es

Resource Scan

Scan Details

Site Domain cordopolis.eldiario.es
Base Domain eldiario.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-28T21:41:42+00:00
Next Scan 2024-10-27T21:41:42+00:00

Last Successful Scan

Scanned2024-06-07T21:27:58+00:00
URL https://cordopolis.eldiario.es/robots.txt
Domain IPs 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4
Response IP 212.102.42.89
Found Yes
Hash d396974069da812a8cb1ee228742f1b9b375e9f62edb676f2ee4a10c13888a02
SimHash a8de198ccc63

Groups

*

Rule Path
Disallow /api/
Disallow /api/comment/user/featureds
Disallow /api/comment/user/subscribers
Disallow /api/comment/user/muted
Disallow /api/comment/user/voted
Disallow /bbtcaptcha/
Disallow /bbtcomment/create/
Disallow /bbtcomment/vote/
Disallow /bbtcomment/report/
Disallow /bbtcomment/entityComments/
Disallow /bbtcontent/poll/vote/
Disallow /bbtcontent/poll/getresults/
Disallow /props/
Disallow /bbtmail/sendEntity/
Disallow /bbtshop/
Disallow /bbtstats/
Disallow /logout.html

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cordopolis.eldiario.es/sitemap_index_17044.xml
sitemap https://cordopolis.eldiario.es/sitemap_google_news_17044.xml

Comments

  • Agentes nocivos conocidos