prosveshenie.kz
robots.txt

Robots Exclusion Standard data for prosveshenie.kz

Resource Scan

Scan Details

Site Domain prosveshenie.kz
Base Domain prosveshenie.kz
Scan Status Ok
Last Scan2024-09-21T06:22:54+00:00
Next Scan 2024-10-21T06:22:54+00:00

Last Scan

Scanned2024-09-21T06:22:54+00:00
URL https://prosveshenie.kz/robots.txt
Domain IPs 194.39.67.52
Response IP 194.39.67.52
Found Yes
Hash 89c20f7a83d0d9e544e4e824c32876a98e8cdf05ea2ae0ce1e6ab7ad9af56572
SimHash d9221d0085cb

Groups

*

Rule Path
Disallow /prosvet/
Disallow /add-bg-list
Disallow /add-bg
Disallow /add-postinfo
Disallow /add-review
Disallow /add-section
Disallow /add-services
Disallow /admin-adresslist
Disallow /admin-blankolymp
Disallow /admin-concurs
Disallow /admin-conferenc
Disallow /admin-course
Disallow /admin-diplom
Disallow /admin-enc
Disallow /admin-index
Disallow /admin-journal
Disallow /admin-onlin-concurs
Disallow /admin-password
Disallow /admin-webinar
Disallow /application-account
Disallow /blank-olymp
Disallow /blankolymp-certificate
Disallow /blankolymp-list
Disallow /blankolymp-users
Disallow /certificate-certificate
Disallow /concurs-certificate
Disallow /concurs-student
Disallow /concurs-teacher
Disallow /concurs-users
Disallow /conferenc-student
Disallow /conferenc-teacher
Disallow /conferenc-users
Disallow /course-certificate
Disallow /course-users
Disallow /diplom-user
Disallow /edit-profile-teacher
Disallow /enc-certificate
Disallow /enc-users
Disallow /financial-operations
Disallow /job-edit
Disallow /job-list
Disallow /job-review
Disallow /job
Disallow /journal-certificate
Disallow /journal-users
Disallow /journal
Disallow /login-password
Disallow /message
Disallow /onlin-certificate
Disallow /onlin-concurs
Disallow /onlin-users
Disallow /personal-account
Disallow /pr-admin
Disallow /recharge
Disallow /remittance
Disallow /request-contest
Disallow /restore
Disallow /search-user
Disallow /services-category
Disallow /services_offline
Disallow /student
Disallow /teacher
Disallow /upd-services-list
Disallow /upd-services
Disallow /user-list
Disallow /user-profile
Disallow /webinar-certificate
Disallow /webinar-users
Disallow /add-bg-list
Disallow /add-bg
Disallow /add-postinfo
Disallow /add-review
Disallow /add-section
Disallow /add-services
Disallow /admin-adresslist
Disallow /admin-blankolymp
Disallow /admin-concurs
Disallow /admin-conferenc
Disallow /admin-course
Disallow /admin-diplom
Disallow /admin-enc
Disallow /admin-index
Disallow /admin-journal
Disallow /admin-onlin-concurs
Disallow /admin-password
Disallow /admin-webinar
Disallow /application-account
Disallow /blank-olymp
Disallow /blankolymp-certificate
Disallow /blankolymp-list
Disallow /blankolymp-users
Disallow /certificate-certificate
Disallow /concurs-certificate
Disallow /concurs-student
Disallow /concurs-teacher
Disallow /concurs-users
Disallow /conferenc-student
Disallow /conferenc-teacher
Disallow /conferenc-users
Disallow /course-certificate
Disallow /course-users
Disallow /diplom-user
Disallow /edit-profile-teacher
Disallow /enc-certificate
Disallow /enc-users
Disallow /financial-operations
Disallow /job-edit
Disallow /job-list
Disallow /job-review
Disallow /job
Disallow /journal-certificate
Disallow /journal-users
Disallow /journal
Disallow /login-password
Disallow /message
Disallow /onlin-certificate
Disallow /onlin-concurs
Disallow /onlin-users
Disallow /personal-account
Disallow /pr-admin
Disallow /recharge
Disallow /remittance
Disallow /request-contest
Disallow /restore
Disallow /search-user
Disallow /services-category
Disallow /services_offline
Disallow /student
Disallow /teacher
Disallow /upd-services-list
Disallow /upd-services
Disallow /user-list
Disallow /user-profile
Disallow /webinar-certificate
Disallow /webinar-users
Disallow /web/docoment/
Disallow /docoment/
Disallow /file
Disallow /web/file
Disallow /result-test/
Disallow /test/
Disallow /find-exit/
Disallow /all-certificate
Disallow /find/
Disallow /my-request
Disallow /uploads/
Disallow /web/uploads/

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2.0

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

applewebkit

Rule Path
Disallow /

applewebkit/605.1.15

Rule Path
Disallow /

applewebkit/537.36

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /prosvet/
Disallow /add-bg-list
Disallow /add-bg
Disallow /add-postinfo
Disallow /add-review
Disallow /add-section
Disallow /add-services
Disallow /admin-adresslist
Disallow /admin-blankolymp
Disallow /admin-concurs
Disallow /admin-conferenc
Disallow /admin-course
Disallow /admin-diplom
Disallow /admin-enc
Disallow /admin-index
Disallow /admin-journal
Disallow /admin-onlin-concurs
Disallow /admin-password
Disallow /admin-webinar
Disallow /application-account
Disallow /blank-olymp
Disallow /blankolymp-certificate
Disallow /blankolymp-list
Disallow /blankolymp-users
Disallow /certificate-certificate
Disallow /concurs-certificate
Disallow /concurs-student
Disallow /concurs-teacher
Disallow /concurs-users
Disallow /conferenc-student
Disallow /conferenc-teacher
Disallow /conferenc-users
Disallow /course-certificate
Disallow /course-users
Disallow /diplom-user
Disallow /edit-profile-teacher
Disallow /enc-certificate
Disallow /enc-users
Disallow /financial-operations
Disallow /job-edit
Disallow /job-list
Disallow /job-review
Disallow /job
Disallow /journal-certificate
Disallow /journal-users
Disallow /journal
Disallow /login-password
Disallow /message
Disallow /onlin-certificate
Disallow /onlin-concurs
Disallow /onlin-users
Disallow /personal-account
Disallow /pr-admin
Disallow /recharge
Disallow /remittance
Disallow /request-contest
Disallow /restore
Disallow /search-user
Disallow /services-category
Disallow /services_offline
Disallow /student
Disallow /teacher
Disallow /upd-services-list
Disallow /upd-services
Disallow /user-list
Disallow /user-profile
Disallow /webinar-certificate
Disallow /webinar-users
Disallow /add-bg-list
Disallow /add-bg
Disallow /add-postinfo
Disallow /add-review
Disallow /add-section
Disallow /add-services
Disallow /admin-adresslist
Disallow /admin-blankolymp
Disallow /admin-concurs
Disallow /admin-conferenc
Disallow /admin-course
Disallow /admin-diplom
Disallow /admin-enc
Disallow /admin-index
Disallow /admin-journal
Disallow /admin-onlin-concurs
Disallow /admin-password
Disallow /admin-webinar
Disallow /application-account
Disallow /blank-olymp
Disallow /blankolymp-certificate
Disallow /blankolymp-list
Disallow /blankolymp-users
Disallow /certificate-certificate
Disallow /concurs-certificate
Disallow /concurs-student
Disallow /concurs-teacher
Disallow /concurs-users
Disallow /conferenc-student
Disallow /conferenc-teacher
Disallow /conferenc-users
Disallow /course-certificate
Disallow /course-users
Disallow /diplom-user
Disallow /edit-profile-teacher
Disallow /enc-certificate
Disallow /enc-users
Disallow /financial-operations
Disallow /job-edit
Disallow /job-list
Disallow /job-review
Disallow /job
Disallow /journal-certificate
Disallow /journal-users
Disallow /journal
Disallow /login-password
Disallow /message
Disallow /onlin-certificate
Disallow /onlin-concurs
Disallow /onlin-users
Disallow /personal-account
Disallow /pr-admin
Disallow /recharge
Disallow /remittance
Disallow /request-contest
Disallow /restore
Disallow /search-user
Disallow /services-category
Disallow /services_offline
Disallow /student
Disallow /teacher
Disallow /upd-services-list
Disallow /upd-services
Disallow /user-list
Disallow /user-profile
Disallow /webinar-certificate
Disallow /webinar-users
Disallow /web/docoment/
Disallow /docoment/
Disallow /file
Disallow /web/file
Disallow /result-test/
Disallow /test/
Disallow /find-exit/
Disallow /all-certificate
Disallow /find/
Disallow /my-request
Disallow /uploads/
Disallow /web/uploads/

Other Records

Field Value
crawl-delay 2.0

Warnings

  • `host` is not a known field.