mediahuis.be
robots.txt
Robots Exclusion Standard data for mediahuis.be
Resource Scan
Scan Details
| Site Domain | mediahuis.be |
| Base Domain | mediahuis.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-19T23:04:26+00:00 |
| Next Scan | 2024-07-18T23:04:26+00:00 |
Last Successful Scan
| Scanned | 2023-03-04T14:26:04+00:00 |
| URL | https://mediahuis.be/robots.txt |
| Domain IPs | 104.16.208.34, 104.18.73.21, 2606:4700::6810:d022, 2606:4700::6812:4915 |
| Response IP | 104.18.73.21 |
| Found | Yes |
| Hash | 6e5fde8ee6b3127bc8496ba348c094b8218ba110491470d7ed2a97b61a23a78e |
| SimHash | 6b109c406db0 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mediahuis.com/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments