losdetectives.es
robots.txt

Robots Exclusion Standard data for losdetectives.es

Resource Scan

Scan Details

Site Domain losdetectives.es
Base Domain losdetectives.es
Scan Status Ok
Last Scan2024-11-16T10:24:59+00:00
Next Scan 2024-11-23T10:24:59+00:00

Last Scan

Scanned2024-11-16T10:24:59+00:00
URL https://losdetectives.es/robots.txt
Redirect https://www.losdetectives.es/robots.txt
Redirect Domain www.losdetectives.es
Redirect Base losdetectives.es
Domain IPs 178.32.96.93
Redirect IPs 178.32.96.93
Response IP 178.32.96.93
Found Yes
Hash 6d5b55b0c0404b5eefa84b3ddfbc669b56c028519735365ad8a3610a321826fe
SimHash 0941da80e190

Groups

*

Rule Path
Disallow /investigadores/buscar
Disallow /investigadores/confirmacion
Disallow /ofertas/buscar
Disallow /1.0/
Disallow /*?iframe=true*$
Disallow *..$

mediapartners-google

Rule Path
Disallow

gaisbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.