dagsavisen.no
robots.txt

Robots Exclusion Standard data for dagsavisen.no

Resource Scan

Scan Details

Site Domain dagsavisen.no
Base Domain dagsavisen.no
Scan Status Ok
Last Scan2024-11-15T11:58:58+00:00
Next Scan 2024-11-22T11:58:58+00:00

Last Scan

Scanned2024-11-15T11:58:58+00:00
URL https://dagsavisen.no/robots.txt
Redirect https://www.dagsavisen.no/robots.txt
Redirect Domain www.dagsavisen.no
Redirect Base dagsavisen.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 184.87.193.72, 184.87.193.80, 2600:1413:b000:13::b857:c18b, 2600:1413:b000:13::b857:c190
Response IP 42.99.140.160
Found Yes
Hash c3aedc7dda8cd28a821b13686f1f9da8634b8c9339b80ce2e424105596fbd7c8
SimHash 09408bd60d73

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.dagsavisen.no/arc/outboundfeeds/news-sitemap-index/?outputType=xml
sitemap https://www.dagsavisen.no/arc/outboundfeeds/sitemap-index/?outputType=xml

Comments

  • robots for www.dagsavisen.no