diario.madrid.es
robots.txt

Robots Exclusion Standard data for diario.madrid.es

Resource Scan

Scan Details

Site Domain diario.madrid.es
Base Domain madrid.es
Scan Status Ok
Last Scan2024-11-03T08:49:01+00:00
Next Scan 2024-11-17T08:49:01+00:00

Last Scan

Scanned2024-11-03T08:49:01+00:00
URL https://diario.madrid.es/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bdd, 2600:1413:b000:6::17d5:2bdf, 96.17.96.11, 96.17.96.29
Response IP 23.44.4.178
Found Yes
Hash 897ea5f57856f53ec25035909e63562c4a26e998b92d445569f99351f4cb47dc
SimHash fd22ac73ed72

Groups

*

Rule Path
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /calendar-2/action~posterboard/
Disallow /calendar-2/action~agenda/
Disallow /calendar-2/action~oneday/
Disallow /calendar-2/action~month/
Disallow /calendar-2/action~week/
Disallow /calendar-2/action~stream/
Disallow /calendar-2/action~undefined/
Disallow /calendar-2/action~http%3A/
Disallow /calendar-2/action~default/
Disallow /calendar-2/action~poster/
Disallow /calendar-2/action~*/
Disallow /calendar__trashed/action~posterboard/
Disallow /calendar__trashed/action~agenda/
Disallow /calendar__trashed/action~oneday/
Disallow /calendar__trashed/action~month/
Disallow /calendar__trashed/action~week/
Disallow /calendar__trashed/action~stream/
Disallow /calendar__trashed/action~undefined/
Disallow /calendar__trashed/action~http%3A/
Disallow /calendar__trashed/action~default/
Disallow /calendar__trashed/action~poster/
Disallow /calendar__trashed/action~*/