kzen.dev
robots.txt
Robots Exclusion Standard data for kzen.dev
Resource Scan
Scan Details
| Site Domain | kzen.dev |
| Base Domain | kzen.dev |
| Scan Status | Ok |
| Last Scan | 2024-11-11T15:56:39+00:00 |
| Next Scan | 2024-11-18T15:56:39+00:00 |
Last Scan
| Scanned | 2024-11-11T15:56:39+00:00 |
| URL | https://kzen.dev/robots.txt |
| Domain IPs | 104.21.11.125, 172.67.166.8, 2606:4700:3030::6815:b7d, 2606:4700:3037::ac43:a608 |
| Response IP | 172.67.166.8 |
| Found | Yes |
| Hash | 3f392047e4f750f376a64dcbfaa0ba9824834d58a81fbf68efb44c16ca3ab668 |
| SimHash | 40115d2868da |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /api |
| Disallow | /*/tags/* |
| Disallow | /*/categories/* |
| Disallow | /*/questions/edit/* |
| Disallow | /*/answer/edit/* |
| Disallow | /*/comment/edit/* |
| Disallow | /*/tag/edit/* |
| Disallow | /search |
| Disallow | /link |
| Disallow | /*/search |
| Allow | /sitemap* |
yandexbot
yandexmobilebot
yandexmarket
yandexfordomain
yandexadnet
yandexblogs
yandeximages
yandeximageresizer
yandexmedia
yandexnews
yandexontodb
yandexpagechecker
yandexsitelinks
yandexspravbot
yandexturbo
yandexvertis
yandexverticals
yandexvideo
yandexvideoparser
yandexwebmaster
mail.ru
| Rule | Path |
|---|---|
| Allow | /ru |
| Allow | /kk |
| Allow | /tr |
| Allow | /id |
| Allow | /uz |
| Allow | /sk |
| Allow | /by |
| Allow | /ru/users |
| Allow | /ru/users* |
| Allow | /$ |
| Allow | /sitemap* |
| Disallow | /sk/users |
| Disallow | /kk/users |
| Disallow | /id/users |
| Disallow | /uz/users |
| Disallow | /tr/users |
| Disallow | /by/users |
| Disallow | / |
naverbot
naver.com crawler
yeti
soso spider
nutch
yepi
daum
baidu
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
baidu spider 2.0
moget
ichiro
sogou spider
youdaobot
bytespider crawler
goo crawler
coccocbot
| Rule | Path |
|---|---|
| Allow | /ko |
| Allow | /zh |
| Allow | /ja |
| Allow | /id |
| Allow | /hi |
| Allow | /vi |
| Allow | /bn |
| Allow | /th |
| Allow | /$ |
| Allow | /sitemap* |
| Disallow | / |
qwantify
exabot
startpage
startpagebot
| Rule | Path |
|---|---|
| Allow | /bg |
| Allow | /cs |
| Allow | /da |
| Allow | /de |
| Allow | /el |
| Allow | /es |
| Allow | /et |
| Allow | /fi |
| Allow | /fr |
| Allow | /hu |
| Allow | /it |
| Allow | /lt |
| Allow | /lv |
| Allow | /nl |
| Allow | /pl |
| Allow | /pt |
| Allow | /ro |
| Allow | /ru |
| Allow | /sk |
| Allow | /sl |
| Allow | /sv |
| Allow | /uk |
| Allow | /$ |
| Allow | /sitemap* |
| Disallow | / |
majestic-seo
majestic-12
majestic-12 distributed search bot 1.2
mj12bot
copyscape
blexbot
livelapbot
dnyzbot
traacker
semrushbot
semrush crawler
ahrefsbot
wikido
grammarly
postman runtime
grapeshotcrawler
bytespider
voltron
seokicks crawler
seokicks
speedcurve speed tester 1.0
speedcurve
dotbot
linkdexbot
tineye-bot
admantx platform semantic analyzer
seokicks-robot
yeti
turnitinbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://kzen.dev/sitemap/index.xml |
| sitemap | https://kzen.dev/sitemap-google/index.xml |
| sitemap | https://kzen.dev/sitemap/yandex/index-good.xml |
| sitemap | https://kzen.dev/sitemap-google/index.xml |
Warnings
- `clean-param` is not a known field.