metronieuws.nl
robots.txt
Robots Exclusion Standard data for metronieuws.nl
Resource Scan
Scan Details
| Site Domain | metronieuws.nl |
| Base Domain | metronieuws.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-16T09:58:18+00:00 |
| Next Scan | 2024-11-23T09:58:18+00:00 |
Last Scan
| Scanned | 2024-11-16T09:58:18+00:00 |
| URL | https://metronieuws.nl/robots.txt |
| Domain IPs | 104.18.16.37, 104.18.17.37, 2606:4700::6812:1025, 2606:4700::6812:1125 |
| Response IP | 104.18.17.37 |
| Found | Yes |
| Hash | bf80430e2a85703aa6109c2493782faf74d6670bd7c7c4feda30293b9bb750ac |
| SimHash | cb04dc40a9b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-json/ |
| Disallow | /search/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.metronieuws.nl/sitemap_index.xml |
Warnings
- 1 invalid line.