radio-espana.es
robots.txt

Robots Exclusion Standard data for radio-espana.es

Resource Scan

Scan Details

Site Domain radio-espana.es
Base Domain radio-espana.es
Scan Status Ok
Last Scan2024-05-31T22:03:27+00:00
Next Scan 2024-06-07T22:03:27+00:00

Last Scan

Scanned2024-05-31T22:03:27+00:00
URL https://radio-espana.es/robots.txt
Redirect https://www.radio-espana.es/robots.txt
Redirect Domain www.radio-espana.es
Redirect Base radio-espana.es
Domain IPs 162.19.80.171, 2001:41d0:30a:ab00::
Redirect IPs 162.19.80.171, 2001:41d0:30a:ab00::
Response IP 162.19.80.171
Found Yes
Hash bb6b7a7419743fa8c96779cc564ef0b439afa38cfdf2273cb9f6450d4c3b9666
SimHash 6906404af710

Groups

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

unwindfetchor

Rule Path
Disallow /

metauri

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /search
Disallow /cherche
Disallow /procura
Disallow /busca
Disallow /cerca
Disallow /sok