dn.no
robots.txt

Robots Exclusion Standard data for dn.no

Resource Scan

Scan Details

Site Domain dn.no
Base Domain dn.no
Scan Status Ok
Last Scan2024-06-13T06:26:31+00:00
Next Scan 2024-06-20T06:26:31+00:00

Last Scan

Scanned2024-06-13T06:26:31+00:00
URL https://dn.no/robots.txt
Redirect https://www.dn.no/robots.txt
Redirect Domain www.dn.no
Redirect Base dn.no
Domain IPs 2a02:c0:ac:6:fe::145, 87.238.33.145
Redirect IPs 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50
Response IP 3.165.82.39
Found Yes
Hash c1edc5f56a3f93d3d4ab861d3510f921938cc042bae0fe63c350131fd81fcbf6
SimHash 485f1fc86591

Groups

*

Rule Path
Disallow /bedriftsbasen/
Disallow */sok/
Disallow /search/
Disallow /ext/
Disallow */pageTools/
Disallow */vinguiden/artikler_vinklubben/
Disallow */mail.do
Disallow /*?service=print
Disallow /play
Disallow /kundeservice/logg-inn/
Disallow /kundeservice/external/
Disallow /kundeservice/api/
Disallow /bli-abonnent/external/
Disallow /bli-abonnent/api/
Disallow /*?*mode=preview*
Disallow */magasinet-utgaven/*
Disallow */d2-utgaven/*
Disallow */avisen/dn*
Disallow */avisen/DN*
Disallow /*?*view=noheader*
Disallow /*?*ignoreRefresh=true*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dn.no/sitemap