Log In Sign Up

tyrvaansanomat.fi
robots.txt

Robots Exclusion Standard data for tyrvaansanomat.fi

Resource Scan

Scan Details

Site Domain tyrvaansanomat.fi
Base Domain tyrvaansanomat.fi
Scan Status Ok
Last Scan2024-05-23T05:52:14+00:00
Next Scan 2024-05-30T05:52:14+00:00

Last Scan

Scanned2024-05-23T05:52:14+00:00
URL https://tyrvaansanomat.fi/robots.txt
Redirect https://www.tyrvaansanomat.fi/robots.txt
Redirect Domain www.tyrvaansanomat.fi
Redirect Base tyrvaansanomat.fi
Domain IPs 18.154.144.18, 18.154.144.20, 18.154.144.49, 18.154.144.79, 2600:9000:2024:1400:1d:76fb:78c0:93a1, 2600:9000:2024:3e00:1d:76fb:78c0:93a1, 2600:9000:2024:6000:1d:76fb:78c0:93a1, 2600:9000:2024:6600:1d:76fb:78c0:93a1, 2600:9000:2024:7e00:1d:76fb:78c0:93a1, 2600:9000:2024:8800:1d:76fb:78c0:93a1, 2600:9000:2024:c00:1d:76fb:78c0:93a1, 2600:9000:2024:e800:1d:76fb:78c0:93a1
Redirect IPs 2600:9000:2024:6400:1f:ec05:9440:93a1, 2600:9000:2024:7e00:1f:ec05:9440:93a1, 2600:9000:2024:8200:1f:ec05:9440:93a1, 2600:9000:2024:a200:1f:ec05:9440:93a1, 2600:9000:2024:a400:1f:ec05:9440:93a1, 2600:9000:2024:c00:1f:ec05:9440:93a1, 2600:9000:2024:f400:1f:ec05:9440:93a1, 2600:9000:2024:f600:1f:ec05:9440:93a1, 65.9.112.39, 65.9.112.48, 65.9.112.5, 65.9.112.51
Response IP 108.157.52.40
Found Yes
Hash 1d576e5f64e3136019a945e922af5c147e95b8c84d54aa2a7e46f50d97986d11
SimHash 4918c260c113

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Disallow /public-transit-screen/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.tyrvaansanomat.fi/sitemap/html/tyr/sitemapindex.xml
sitemap https://www.tyrvaansanomat.fi/rss/custom/news-sitemap.xml
Back to top