valkeakoskensanomat.fi
robots.txt

Robots Exclusion Standard data for valkeakoskensanomat.fi

Resource Scan

Scan Details

Site Domain valkeakoskensanomat.fi
Base Domain valkeakoskensanomat.fi
Scan Status Ok
Last Scan2024-05-24T03:10:47+00:00
Next Scan 2024-05-31T03:10:47+00:00

Last Scan

Scanned2024-05-24T03:10:47+00:00
URL https://valkeakoskensanomat.fi/robots.txt
Redirect https://www.valkeakoskensanomat.fi/robots.txt
Redirect Domain www.valkeakoskensanomat.fi
Redirect Base valkeakoskensanomat.fi
Domain IPs 13.226.2.4, 13.226.2.50, 13.226.2.78, 13.226.2.93, 2600:9000:24bb:2400:18:4a14:12c0:93a1, 2600:9000:24bb:2e00:18:4a14:12c0:93a1, 2600:9000:24bb:3e00:18:4a14:12c0:93a1, 2600:9000:24bb:6400:18:4a14:12c0:93a1, 2600:9000:24bb:9800:18:4a14:12c0:93a1, 2600:9000:24bb:b200:18:4a14:12c0:93a1, 2600:9000:24bb:e400:18:4a14:12c0:93a1, 2600:9000:24bb:fc00:18:4a14:12c0:93a1
Redirect IPs 18.65.229.121, 18.65.229.125, 18.65.229.15, 18.65.229.83, 2600:9000:234b:2000:1:129a:2dc0:93a1, 2600:9000:234b:3400:1:129a:2dc0:93a1, 2600:9000:234b:9200:1:129a:2dc0:93a1, 2600:9000:234b:9800:1:129a:2dc0:93a1, 2600:9000:234b:a00:1:129a:2dc0:93a1, 2600:9000:234b:be00:1:129a:2dc0:93a1, 2600:9000:234b:e600:1:129a:2dc0:93a1, 2600:9000:234b:ec00:1:129a:2dc0:93a1
Response IP 108.157.52.67
Found Yes
Hash f5eca76281afb65ec405796f618803b8d6cf83b30be0e57cd6dd0a06e2168cef
SimHash 4918c263c136

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Disallow /public-transit-screen/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.valkeakoskensanomat.fi/sitemap/html/vs/sitemapindex.xml
sitemap https://www.valkeakoskensanomat.fi/rss/custom/news-sitemap.xml