sydansatakunta.fi
robots.txt

Robots Exclusion Standard data for sydansatakunta.fi

Resource Scan

Scan Details

Site Domain sydansatakunta.fi
Base Domain sydansatakunta.fi
Scan Status Ok
Last Scan2024-09-28T05:51:27+00:00
Next Scan 2024-10-05T05:51:27+00:00

Last Scan

Scanned2024-09-28T05:51:27+00:00
URL https://sydansatakunta.fi/robots.txt
Redirect https://www.sydansatakunta.fi/robots.txt
Redirect Domain www.sydansatakunta.fi
Redirect Base sydansatakunta.fi
Domain IPs 2600:9000:2175:1a00:1d:76fb:78c0:93a1, 2600:9000:2175:2200:1d:76fb:78c0:93a1, 2600:9000:2175:2600:1d:76fb:78c0:93a1, 2600:9000:2175:3e00:1d:76fb:78c0:93a1, 2600:9000:2175:6200:1d:76fb:78c0:93a1, 2600:9000:2175:9200:1d:76fb:78c0:93a1, 2600:9000:2175:a600:1d:76fb:78c0:93a1, 2600:9000:2175:d400:1d:76fb:78c0:93a1, 52.84.45.111, 52.84.45.34, 52.84.45.90, 52.84.45.96
Redirect IPs 13.226.2.113, 13.226.2.27, 13.226.2.41, 13.226.2.66, 2600:9000:2022:2200:7:d10a:2c40:93a1, 2600:9000:2022:7200:7:d10a:2c40:93a1, 2600:9000:2022:8600:7:d10a:2c40:93a1, 2600:9000:2022:b800:7:d10a:2c40:93a1, 2600:9000:2022:cc00:7:d10a:2c40:93a1, 2600:9000:2022:ea00:7:d10a:2c40:93a1, 2600:9000:2022:f000:7:d10a:2c40:93a1, 2600:9000:2022:f800:7:d10a:2c40:93a1
Response IP 13.226.2.27
Found Yes
Hash eba4dc802ffb79e225ea639e632bc4f2482eb8e17b58cc58d5d77ed6b88b8fa8
SimHash 411c4153c011

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Disallow /public-transit-screen/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sydansatakunta.fi/sitemap/html/ss/sitemapindex.xml
sitemap https://www.sydansatakunta.fi/rss/custom/news-sitemap.xml