Log In Sign Up

hs.fi
robots.txt

Robots Exclusion Standard data for hs.fi

Resource Scan

Scan Details

Site Domain hs.fi
Base Domain hs.fi
Scan Status Ok
Last Scan2024-04-26T19:38:50+00:00
Next Scan 2024-05-03T19:38:50+00:00

Last Scan

Scanned2024-04-26T19:38:50+00:00
URL https://hs.fi/robots.txt
Redirect https://www.hs.fi/robots.txt
Redirect Domain www.hs.fi
Redirect Base hs.fi
Domain IPs 13.226.2.102, 13.226.2.107, 13.226.2.45, 13.226.2.50, 2600:9000:24bb:2a00:b:5b2c:9f40:93a1, 2600:9000:24bb:6c00:b:5b2c:9f40:93a1, 2600:9000:24bb:7a00:b:5b2c:9f40:93a1, 2600:9000:24bb:8c00:b:5b2c:9f40:93a1, 2600:9000:24bb:b400:b:5b2c:9f40:93a1, 2600:9000:24bb:c400:b:5b2c:9f40:93a1, 2600:9000:24bb:e400:b:5b2c:9f40:93a1, 2600:9000:24bb:f400:b:5b2c:9f40:93a1
Redirect IPs 13.226.2.122, 13.226.2.31, 13.226.2.66, 13.226.2.95, 2600:9000:2163:1800:10:3b34:7000:93a1, 2600:9000:2163:2e00:10:3b34:7000:93a1, 2600:9000:2163:5400:10:3b34:7000:93a1, 2600:9000:2163:9200:10:3b34:7000:93a1, 2600:9000:2163:a000:10:3b34:7000:93a1, 2600:9000:2163:ba00:10:3b34:7000:93a1, 2600:9000:2163:be00:10:3b34:7000:93a1, 2600:9000:2163:da00:10:3b34:7000:93a1
Response IP 18.165.171.109
Found Yes
Hash bccdf68b60c459a2c2851e3373428cfe2c63b518a8a6a1474cc744cee0c1efac
SimHash 4b2c8a60e137

Groups

*

Rule Path
Disallow /promo/
Disallow /sivulaskuri
Disallow /api/
Disallow /rest/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.hs.fi/sitemap/html/hs/sitemapindex.xml
sitemap https://www.hs.fi/rss/custom/news-sitemap.xml
Back to top