servicios.20minutos.es
robots.txt

Robots Exclusion Standard data for servicios.20minutos.es

Resource Scan

Scan Details

Site Domain servicios.20minutos.es
Base Domain 20minutos.es
Scan Status Ok
Last Scan2024-05-04T17:15:39+00:00
Next Scan 2024-05-18T17:15:39+00:00

Last Scan

Scanned2024-05-04T17:15:39+00:00
URL https://servicios.20minutos.es/robots.txt
Domain IPs 178.32.100.222
Response IP 178.32.100.222
Found Yes
Hash 80b9015160f43062b9c74637722cac219e47942e71b5529c8619064a8a4b56eb
SimHash 8955de80c191

Groups

*

Rule Path
Disallow /guia/buscar
Disallow /ofertas/buscar
Disallow /1.0/
Disallow /*?iframe=true*$
Disallow *..$

mediapartners-google

Rule Path
Disallow

gaisbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.