Log In Sign Up

kmvlehti.fi
robots.txt

Robots Exclusion Standard data for kmvlehti.fi

Resource Scan

Scan Details

Site Domain kmvlehti.fi
Base Domain kmvlehti.fi
Scan Status Ok
Last Scan2024-05-27T17:03:23+00:00
Next Scan 2024-06-03T17:03:23+00:00

Last Scan

Scanned2024-05-27T17:03:23+00:00
URL https://kmvlehti.fi/robots.txt
Redirect https://www.kmvlehti.fi/robots.txt
Redirect Domain www.kmvlehti.fi
Redirect Base kmvlehti.fi
Domain IPs 18.161.135.101, 18.161.135.120, 18.161.135.125, 18.161.135.54, 2600:9000:2462:5400:18:4a14:12c0:93a1, 2600:9000:2462:6800:18:4a14:12c0:93a1, 2600:9000:2462:7a00:18:4a14:12c0:93a1, 2600:9000:2462:9e00:18:4a14:12c0:93a1, 2600:9000:2462:aa00:18:4a14:12c0:93a1, 2600:9000:2462:c600:18:4a14:12c0:93a1, 2600:9000:2462:d200:18:4a14:12c0:93a1, 2600:9000:2462:fa00:18:4a14:12c0:93a1
Redirect IPs 18.164.154.12, 18.164.154.14, 18.164.154.66, 18.164.154.96, 2600:9000:24b9:3c00:1e:cddc:76c0:93a1, 2600:9000:24b9:6000:1e:cddc:76c0:93a1, 2600:9000:24b9:6200:1e:cddc:76c0:93a1, 2600:9000:24b9:7000:1e:cddc:76c0:93a1, 2600:9000:24b9:7200:1e:cddc:76c0:93a1, 2600:9000:24b9:7c00:1e:cddc:76c0:93a1, 2600:9000:24b9:ba00:1e:cddc:76c0:93a1, 2600:9000:24b9:c800:1e:cddc:76c0:93a1
Response IP 108.157.52.101
Found Yes
Hash 615df1afd3ff6cc711e2520867d7209c8fd8bc07ee60759cf15253d9d4325ea2
SimHash 491cd941c533

Groups

*

Rule Path
Disallow /promo/
Disallow /public-transit-screen/
Disallow /api/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.kmvlehti.fi/sitemap/html/kmv/sitemapindex.xml
sitemap https://www.kmvlehti.fi/rss/custom/news-sitemap.xml
Back to top