ktk.kz
robots.txt

Robots Exclusion Standard data for ktk.kz

Resource Scan

Scan Details

Site Domain ktk.kz
Base Domain ktk.kz
Scan Status Ok
Last Scan2024-06-15T09:28:52+00:00
Next Scan 2024-06-22T09:28:52+00:00

Last Scan

Scanned2024-06-15T09:28:52+00:00
URL https://ktk.kz/robots.txt
Redirect https://www.ktk.kz/robots.txt
Redirect Domain www.ktk.kz
Redirect Base ktk.kz
Domain IPs 91.215.139.2
Redirect IPs 91.215.139.2
Response IP 91.215.139.2
Found Yes
Hash 20060990778df58f008211c0260c1a6a1020a9ceea9a8309cf5032c8ee355073
SimHash 7e849c51c7b7

Groups

*

Rule Path
Allow /
Allow /ru/blog
Allow /kz/blog
Disallow /wedding/
Disallow /SmartTV/
Disallow /mobile/
Disallow /live/
Disallow /ajax/
Disallow /design/
Disallow /ckfinder/
Disallow /admin/
Disallow /FlashPlayer/
Disallow /ru/archive/
Disallow /kz/archive/
Disallow /ru/blog/article/2016/03/10/67609/
Disallow /kz/blog/article/2016/03/10/67609/
Disallow /informers/
Disallow /ru/gallery/
Disallow /kz/gallery/
Disallow /test/
Disallow /push/

Other Records

Field Value
crawl-delay 20

twitterbot

Rule Path
Allow *

yandex

Rule Path
Allow /
Allow /ru/blog
Allow /kz/blog
Disallow /wedding/
Disallow /SmartTV/
Disallow /mobile/
Disallow /live/
Disallow /ajax/
Disallow /design/
Disallow /ckfinder/
Disallow /admin/
Disallow /FlashPlayer/
Disallow /ru/archive/
Disallow /kz/archive/
Disallow /ru/blog/article/2016/03/10/67609/
Disallow /kz/blog/article/2016/03/10/67609/
Disallow /informers/
Disallow /ru/gallery/
Disallow /kz/gallery/
Disallow /test/
Disallow /push/

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Allow /
Allow /ru/blog
Allow /kz/blog
Disallow /wedding/
Disallow /SmartTV/
Disallow /mobile/
Disallow /live/
Disallow /ajax/
Disallow /design/
Disallow /ckfinder/
Disallow /admin/
Disallow /FlashPlayer/
Disallow /ru/archive/
Disallow /kz/archive/
Disallow /ru/blog/article/2016/03/10/67609/
Disallow /kz/blog/article/2016/03/10/67609/
Disallow /informers/
Disallow /ru/gallery/
Disallow /kz/gallery/
Disallow /test/
Disallow /push/

Other Records

Field Value
crawl-delay 20

googlebot

Rule Path
Allow /
Allow /ru/blog
Allow /kz/blog
Disallow /wedding/
Disallow /SmartTV/
Disallow /mobile/
Disallow /live/
Disallow /ajax/
Disallow /design/
Disallow /ckfinder/
Disallow /admin/
Disallow /FlashPlayer/
Disallow /ru/archive/
Disallow /kz/archive/
Disallow /ru/blog/article/2016/03/10/67609/
Disallow /kz/blog/article/2016/03/10/67609/
Disallow /informers/
Disallow /ru/gallery/
Disallow /kz/gallery/
Disallow /test/
Disallow /push/

Other Records

Field Value
crawl-delay 20

mediapartners-google

Rule Path
Allow /ru/

Other Records

Field Value
sitemap https://www.ktk.kz/sitemap.xml
sitemap https://www.ktk.kz/sitemap.xml
sitemap https://www.ktk.kz/sitemap.xml
sitemap https://www.ktk.kz/sitemap.xml

Comments

  • YANDEX Bots
  • YAHOO Bots
  • GOOGLE Bots