satakunnankansa.fi
robots.txt

Robots Exclusion Standard data for satakunnankansa.fi

Resource Scan

Scan Details

Site Domain satakunnankansa.fi
Base Domain satakunnankansa.fi
Scan Status Ok
Last Scan2024-09-20T10:34:46+00:00
Next Scan 2024-09-27T10:34:46+00:00

Last Scan

Scanned2024-09-20T10:34:46+00:00
URL https://satakunnankansa.fi/robots.txt
Redirect https://www.satakunnankansa.fi/robots.txt
Redirect Domain www.satakunnankansa.fi
Redirect Base satakunnankansa.fi
Domain IPs 13.226.2.4, 13.226.2.50, 13.226.2.78, 13.226.2.93, 2600:9000:21f8:1400:18:4a14:12c0:93a1, 2600:9000:21f8:400:18:4a14:12c0:93a1, 2600:9000:21f8:6400:18:4a14:12c0:93a1, 2600:9000:21f8:8800:18:4a14:12c0:93a1, 2600:9000:21f8:9e00:18:4a14:12c0:93a1, 2600:9000:21f8:a00:18:4a14:12c0:93a1, 2600:9000:21f8:b800:18:4a14:12c0:93a1, 2600:9000:21f8:ca00:18:4a14:12c0:93a1
Redirect IPs 18.161.97.107, 18.161.97.120, 18.161.97.62, 18.161.97.84, 2600:9000:23d0:1200:b:bf8e:cd00:93a1, 2600:9000:23d0:1600:b:bf8e:cd00:93a1, 2600:9000:23d0:3400:b:bf8e:cd00:93a1, 2600:9000:23d0:7a00:b:bf8e:cd00:93a1, 2600:9000:23d0:8600:b:bf8e:cd00:93a1, 2600:9000:23d0:c800:b:bf8e:cd00:93a1, 2600:9000:23d0:ca00:b:bf8e:cd00:93a1, 2600:9000:23d0:d000:b:bf8e:cd00:93a1
Response IP 52.85.49.30
Found Yes
Hash 88417883b5477dfd716df309e96602e15682becb79f0bbf0602e7b310c183a03
SimHash 41184171c610

Groups

*

Rule Path
Disallow /promo/
Disallow /public-transit-screen/
Disallow /api/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.satakunnankansa.fi/sitemap/html/sk/sitemapindex.xml
sitemap https://www.satakunnankansa.fi/rss/custom/news-sitemap.xml