morgenbladet.no
robots.txt

Robots Exclusion Standard data for morgenbladet.no

Resource Scan

Scan Details

Site Domain morgenbladet.no
Base Domain morgenbladet.no
Scan Status Ok
Last Scan2024-11-16T13:22:31+00:00
Next Scan 2024-11-23T13:22:31+00:00

Last Scan

Scanned2024-11-16T13:22:31+00:00
URL https://morgenbladet.no/robots.txt
Redirect https://www.morgenbladet.no/robots.txt
Redirect Domain www.morgenbladet.no
Redirect Base morgenbladet.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 184.87.193.80, 184.87.193.84, 2600:1413:b000:13::b857:c18b, 2600:1413:b000:13::b857:c190
Response IP 42.99.140.160
Found Yes
Hash 75aae215113cfed4ed598152ac50a103c6cd52d76a1b2764764402701685cb81
SimHash 404419d6c573

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.morgenbladet.no/arc/outboundfeeds/news-sitemap-index/?outputType=xml
sitemap https://www.morgenbladet.no/arc/outboundfeeds/sitemap-index/?outputType=xml

Comments

  • robots for www.morgenbladet.no