heraldodiariodesoria.elmundo.es
robots.txt

Robots Exclusion Standard data for heraldodiariodesoria.elmundo.es

Archived Snapshots

Resource Scan

Scan Details

Site Domain	heraldodiariodesoria.elmundo.es
Base Domain	elmundo.es
Scan Status	Ok
Last Scan	2024-11-15T21:28:58+00:00
Next Scan	2024-11-22T21:28:58+00:00

Last Scan

Scanned	2024-11-15T21:28:58+00:00
URL	https://heraldodiariodesoria.elmundo.es/robots.txt
Redirect	https://www.heraldodiariodesoria.es/robots.txt
Redirect Domain	www.heraldodiariodesoria.es
Redirect Base	heraldodiariodesoria.es
Domain IPs	2600:9000:20fe:2e00:1c:f243:fb80:93a1, 2600:9000:20fe:4600:1c:f243:fb80:93a1, 2600:9000:20fe:4c00:1c:f243:fb80:93a1, 2600:9000:20fe:6600:1c:f243:fb80:93a1, 2600:9000:20fe:7c00:1c:f243:fb80:93a1, 2600:9000:20fe:ac00:1c:f243:fb80:93a1, 2600:9000:20fe:ae00:1c:f243:fb80:93a1, 2600:9000:20fe:f200:1c:f243:fb80:93a1, 52.222.144.10, 52.222.144.109, 52.222.144.28, 52.222.144.61
Redirect IPs	2600:9000:20fe:1000:1c:f243:fb80:93a1, 2600:9000:20fe:2400:1c:f243:fb80:93a1, 2600:9000:20fe:2800:1c:f243:fb80:93a1, 2600:9000:20fe:4200:1c:f243:fb80:93a1, 2600:9000:20fe:5200:1c:f243:fb80:93a1, 2600:9000:20fe:6000:1c:f243:fb80:93a1, 2600:9000:20fe:a600:1c:f243:fb80:93a1, 2600:9000:20fe:b600:1c:f243:fb80:93a1, 52.222.144.10, 52.222.144.109, 52.222.144.28, 52.222.144.61
Response IP	18.165.122.21
Found	Yes
Hash	c59bbeeb291d4a4e7b8756b59c15c08f00616ee06e87a316a82a912ae70dc922
SimHash	a0d358c8ced3

Groups

*

Rule	Path
Disallow	/*.swf$
Disallow	/*.tif$
Disallow	/*.mp3$
Disallow	/*.flv$
Disallow	/*.mp4$
Disallow	/*.avi$
Disallow	/*.ics$

Rule

Path

Disallow

/*.swf$

Disallow

/*.tif$

Disallow

/*.mp3$

Disallow

/*.flv$

Disallow

/*.mp4$

Disallow

/*.avi$

Disallow

/*.ics$

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

ubicrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

doc

Rule	Path
Disallow	/

Rule

Path

Disallow

zao

Rule	Path
Disallow	/

Rule

Path

Disallow

sitecheck.internetseer.com

Rule	Path
Disallow	/

Rule

Path

Disallow

zealbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msiecrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

sitesnagger

Rule	Path
Disallow	/

Rule

Path

Disallow

webstripper

Rule	Path
Disallow	/

Rule

Path

Disallow

webcopier

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch

Rule	Path
Disallow	/

Rule

Path

Disallow

offline explorer

Rule	Path
Disallow	/

Rule

Path

Disallow

teleport

Rule	Path
Disallow	/

Rule

Path

Disallow

teleportpro

Rule	Path
Disallow	/

Rule

Path

Disallow

webzip

Rule	Path
Disallow	/

Rule

Path

Disallow

linko

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

microsoft.url.control

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu

Rule	Path
Disallow	/

Rule

Path

Disallow

larbin

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww

Rule	Path
Disallow	/

Rule

Path

Disallow

zyborg

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

maxthon

Rule	Path
Disallow	/

Rule

Path

Disallow

cncdialer

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mailto: techinfo@ubermetrics-technologies.com

Rule	Path
Disallow	/

Rule

Path

Disallow

Comments

Agentes nocivos conocidos

heraldodiariodesoria.elmundo.esrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

ia_archiver

ubicrawler

doc

zao

sitecheck.internetseer.com

zealbot

msiecrawler

sitesnagger

webstripper

webcopier

fetch

offline explorer

teleport

teleportpro

webzip

linko

httrack

microsoft.url.control

xenu

larbin

libwww

zyborg

download ninja

slurp

maxthon

cncdialer

ahrefsbot

mailto: techinfo@ubermetrics-technologies.com

Comments

heraldodiariodesoria.elmundo.es
robots.txt