nu.nl
robots.txt
Robots Exclusion Standard data for nu.nl
Resource Scan
Scan Details
Site Domain | nu.nl |
Base Domain | nu.nl |
Scan Status | Ok |
Last Scan | 2024-10-26T10:36:22+00:00 |
Next Scan | 2024-11-02T10:36:22+00:00 |
Last Scan
Scanned | 2024-10-26T10:36:22+00:00 |
URL | https://nu.nl/robots.txt |
Redirect | https://www.nu.nl/robots.txt |
Redirect Domain | www.nu.nl |
Redirect Base | nu.nl |
Domain IPs | 23.209.46.141, 23.209.46.147, 2600:1413:b000:6::17d5:2bcc, 2600:1413:b000:6::17d5:2bd0 |
Redirect IPs | 23.209.46.141, 23.209.46.147 |
Response IP | 23.209.46.147 |
Found | Yes |
Hash | fb858a5dc1156871e9546863b00689a0314145c9737297ee73e1c2cd4b41dbc7 |
SimHash | 691109514d75 |
Groups
*
Rule | Path |
---|---|
Disallow | /zoeken |
Disallow | /search |
Disallow | /block/ |
Disallow | /component/ |
Disallow | /components/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.nu.nl/sitemap_index.xml |
sitemap | https://www.nu.nl/sitemap_news.xml |
sitemap | https://www.nu.nl/sitemap_sections.xml |
sitemap | https://www.nu.nl/sitemap_general.xml |
Comments