dn.no
robots.txt
Robots Exclusion Standard data for dn.no
Resource Scan
Scan Details
Site Domain | dn.no |
Base Domain | dn.no |
Scan Status | Ok |
Last Scan | 2024-06-13T06:26:31+00:00 |
Next Scan | 2024-06-20T06:26:31+00:00 |
Last Scan
Scanned | 2024-06-13T06:26:31+00:00 |
URL | https://dn.no/robots.txt |
Redirect | https://www.dn.no/robots.txt |
Redirect Domain | www.dn.no |
Redirect Base | dn.no |
Domain IPs | 2a02:c0:ac:6:fe::145, 87.238.33.145 |
Redirect IPs | 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50 |
Response IP | 3.165.82.39 |
Found | Yes |
Hash | c1edc5f56a3f93d3d4ab861d3510f921938cc042bae0fe63c350131fd81fcbf6 |
SimHash | 485f1fc86591 |
Groups
*
Rule | Path |
---|---|
Disallow | /bedriftsbasen/ |
Disallow | */sok/ |
Disallow | /search/ |
Disallow | /ext/ |
Disallow | */pageTools/ |
Disallow | */vinguiden/artikler_vinklubben/ |
Disallow | */mail.do |
Disallow | /*?service=print |
Disallow | /play |
Disallow | /kundeservice/logg-inn/ |
Disallow | /kundeservice/external/ |
Disallow | /kundeservice/api/ |
Disallow | /bli-abonnent/external/ |
Disallow | /bli-abonnent/api/ |
Disallow | /*?*mode=preview* |
Disallow | */magasinet-utgaven/* |
Disallow | */d2-utgaven/* |
Disallow | */avisen/dn* |
Disallow | */avisen/DN* |
Disallow | /*?*view=noheader* |
Disallow | /*?*ignoreRefresh=true* |
Other Records
Field | Value |
---|---|
sitemap | https://www.dn.no/sitemap |