morgenbladet.no
robots.txt

Robots Exclusion Standard data for morgenbladet.no

Resource Scan

Scan Details

Site Domain morgenbladet.no
Base Domain morgenbladet.no
Scan Status Ok
Last Scan2024-09-21T11:07:40+00:00
Next Scan 2024-09-28T11:07:40+00:00

Last Scan

Scanned2024-09-21T11:07:40+00:00
URL https://morgenbladet.no/robots.txt
Redirect https://www.morgenbladet.no/robots.txt
Redirect Domain www.morgenbladet.no
Redirect Base morgenbladet.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 125.56.219.49, 2600:1413:b000:13::b857:c190, 2600:1413:b000:13::b857:c191, 96.17.72.18
Response IP 23.52.171.129
Found Yes
Hash 75aae215113cfed4ed598152ac50a103c6cd52d76a1b2764764402701685cb81
SimHash 404419d6c573

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.morgenbladet.no/arc/outboundfeeds/news-sitemap-index/?outputType=xml
sitemap https://www.morgenbladet.no/arc/outboundfeeds/sitemap-index/?outputType=xml

Comments

  • robots for www.morgenbladet.no