Log In Sign Up

blogit.hs.fi
robots.txt

Robots Exclusion Standard data for blogit.hs.fi

Resource Scan

Scan Details

Site Domain blogit.hs.fi
Base Domain hs.fi
Scan Status Ok
Last Scan2024-05-07T10:04:56+00:00
Next Scan 2024-05-14T10:04:56+00:00

Last Scan

Scanned2024-05-07T10:04:56+00:00
URL https://blogit.hs.fi/robots.txt
Redirect https://www.hs.fi/robots.txt
Redirect Domain www.hs.fi
Redirect Base hs.fi
Domain IPs 13.226.2.102, 13.226.2.107, 13.226.2.45, 13.226.2.50, 2600:9000:21f8:2000:b:5b2c:9f40:93a1, 2600:9000:21f8:200:b:5b2c:9f40:93a1, 2600:9000:21f8:3000:b:5b2c:9f40:93a1, 2600:9000:21f8:3600:b:5b2c:9f40:93a1, 2600:9000:21f8:4000:b:5b2c:9f40:93a1, 2600:9000:21f8:9600:b:5b2c:9f40:93a1, 2600:9000:21f8:9a00:b:5b2c:9f40:93a1, 2600:9000:21f8:cc00:b:5b2c:9f40:93a1
Redirect IPs 18.154.206.128, 18.154.206.24, 18.154.206.57, 18.154.206.93, 2600:9000:2475:1200:10:3b34:7000:93a1, 2600:9000:2475:1400:10:3b34:7000:93a1, 2600:9000:2475:200:10:3b34:7000:93a1, 2600:9000:2475:3e00:10:3b34:7000:93a1, 2600:9000:2475:400:10:3b34:7000:93a1, 2600:9000:2475:4800:10:3b34:7000:93a1, 2600:9000:2475:7800:10:3b34:7000:93a1, 2600:9000:2475:7c00:10:3b34:7000:93a1
Response IP 18.165.171.68
Found Yes
Hash bccdf68b60c459a2c2851e3373428cfe2c63b518a8a6a1474cc744cee0c1efac
SimHash 4b2c8a60e137

Groups

*

Rule Path
Disallow /promo/
Disallow /sivulaskuri
Disallow /api/
Disallow /rest/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.hs.fi/sitemap/html/hs/sitemapindex.xml
sitemap https://www.hs.fi/rss/custom/news-sitemap.xml
Back to top