Log In Sign Up

jamsanseutu.fi
robots.txt

Robots Exclusion Standard data for jamsanseutu.fi

Resource Scan

Scan Details

Site Domain jamsanseutu.fi
Base Domain jamsanseutu.fi
Scan Status Ok
Last Scan2024-11-16T04:09:41+00:00
Next Scan 2024-11-23T04:09:41+00:00

Last Scan

Scanned2024-11-16T04:09:41+00:00
URL https://jamsanseutu.fi/robots.txt
Redirect https://www.jamsanseutu.fi/robots.txt
Redirect Domain www.jamsanseutu.fi
Redirect Base jamsanseutu.fi
Domain IPs 2600:9000:21f8:1400:18:4a14:12c0:93a1, 2600:9000:21f8:5a00:18:4a14:12c0:93a1, 2600:9000:21f8:6a00:18:4a14:12c0:93a1, 2600:9000:21f8:7c00:18:4a14:12c0:93a1, 2600:9000:21f8:b200:18:4a14:12c0:93a1, 2600:9000:21f8:b400:18:4a14:12c0:93a1, 2600:9000:21f8:d200:18:4a14:12c0:93a1, 2600:9000:21f8:f800:18:4a14:12c0:93a1, 99.86.4.108, 99.86.4.122, 99.86.4.43, 99.86.4.90
Redirect IPs 2600:9000:269b:3000:1e:9533:6300:93a1, 2600:9000:269b:3400:1e:9533:6300:93a1, 2600:9000:269b:400:1e:9533:6300:93a1, 2600:9000:269b:4400:1e:9533:6300:93a1, 2600:9000:269b:a400:1e:9533:6300:93a1, 2600:9000:269b:c200:1e:9533:6300:93a1, 2600:9000:269b:ca00:1e:9533:6300:93a1, 2600:9000:269b:cc00:1e:9533:6300:93a1, 3.160.196.25, 3.160.196.69, 3.160.196.71, 3.160.196.79
Response IP 3.164.68.12
Found Yes
Hash be53e106f5d52e9051ac703925b57f7628d2f0dbb446747a9e4add912638216b
SimHash 4118c151c413

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Disallow /public-transit-screen/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.jamsanseutu.fi/sitemap/html/js/sitemapindex.xml
sitemap https://www.jamsanseutu.fi/rss/custom/news-sitemap.xml
Back to top