nokianuutiset.fi
robots.txt

Robots Exclusion Standard data for nokianuutiset.fi

Resource Scan

Scan Details

Site Domain nokianuutiset.fi
Base Domain nokianuutiset.fi
Scan Status Ok
Last Scan2024-06-22T04:50:14+00:00
Next Scan 2024-06-29T04:50:14+00:00

Last Scan

Scanned2024-06-22T04:50:14+00:00
URL https://nokianuutiset.fi/robots.txt
Redirect https://www.nokianuutiset.fi/robots.txt
Redirect Domain www.nokianuutiset.fi
Redirect Base nokianuutiset.fi
Domain IPs 18.172.170.47, 18.172.170.49, 18.172.170.52, 18.172.170.67, 2600:9000:24ec:2400:18:4a14:12c0:93a1, 2600:9000:24ec:2e00:18:4a14:12c0:93a1, 2600:9000:24ec:7800:18:4a14:12c0:93a1, 2600:9000:24ec:8400:18:4a14:12c0:93a1, 2600:9000:24ec:8e00:18:4a14:12c0:93a1, 2600:9000:24ec:9000:18:4a14:12c0:93a1, 2600:9000:24ec:a600:18:4a14:12c0:93a1, 2600:9000:24ec:e000:18:4a14:12c0:93a1
Redirect IPs 2600:9000:2024:2c00:0:339:1f80:93a1, 2600:9000:2024:5c00:0:339:1f80:93a1, 2600:9000:2024:8000:0:339:1f80:93a1, 2600:9000:2024:b600:0:339:1f80:93a1, 2600:9000:2024:be00:0:339:1f80:93a1, 2600:9000:2024:ce00:0:339:1f80:93a1, 2600:9000:2024:d000:0:339:1f80:93a1, 2600:9000:2024:ec00:0:339:1f80:93a1, 65.9.112.19, 65.9.112.32, 65.9.112.39, 65.9.112.69
Response IP 3.160.246.4
Found Yes
Hash ee36a205293446ea101d5e2359236001fb4937354af99e5ff6fb925857977916
SimHash 4b1c5263cd13

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Disallow /public-transit-screen/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nokianuutiset.fi/sitemap/html/nu/sitemapindex.xml
sitemap https://www.nokianuutiset.fi/rss/custom/news-sitemap.xml