mediahuis.lu
robots.txt

Robots Exclusion Standard data for mediahuis.lu

Resource Scan

Scan Details

Site Domain mediahuis.lu
Base Domain mediahuis.lu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-25T06:17:26+00:00
Next Scan 2025-10-23T06:17:26+00:00

Last Successful Scan

Scanned2023-03-15T12:00:20+00:00
URL https://mediahuis.lu/robots.txt
Domain IPs 104.18.14.49, 104.18.15.49, 2606:4700::6812:e31, 2606:4700::6812:f31
Response IP 104.18.15.49
Found Yes
Hash 68a7e62cef145001049a7a869c166a4ebd701da6c1fc0a4c5d8c8f8f500d5398
SimHash 6b148f4405b4

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.mediahuis.nl/sitemap_index.xml

Comments

  • XML Sitemaps

Warnings

  • 1 invalid line.