deia.es
robots.txt

Robots Exclusion Standard data for deia.es

Resource Scan

Scan Details

Site Domain deia.es
Base Domain deia.es
Scan Status Ok
Last Scan2024-06-09T22:49:20+00:00
Next Scan 2024-06-16T22:49:20+00:00

Last Scan

Scanned2024-06-09T22:49:20+00:00
URL http://deia.es/robots.txt
Redirect https://www.deia.eus/robots.txt
Redirect Domain www.deia.eus
Redirect Base deia.eus
Domain IPs 213.0.95.35
Redirect IPs 199.232.194.133, 199.232.198.133
Response IP 151.101.42.133
Found Yes
Hash be6ad99585d0ce4e3867c52157a5bd6d1be7a7d53b3b992fad45d1c4e334a8cd
SimHash d8044252c733

Groups

twitterbot

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /tags/letra/
Disallow /hemeroteca/buscador/

Warnings

  • `https` is not a known field.