ru.osvita.ua
robots.txt

Robots Exclusion Standard data for ru.osvita.ua

Resource Scan

Scan Details

Site Domain ru.osvita.ua
Base Domain osvita.ua
Scan Status Ok
Last Scan2024-05-26T01:51:25+00:00
Next Scan 2024-06-25T01:51:25+00:00

Last Scan

Scanned2024-05-26T01:51:25+00:00
URL https://ru.osvita.ua/robots.txt
Domain IPs 104.26.8.83, 104.26.9.83, 172.67.70.203, 2606:4700:20::681a:853, 2606:4700:20::681a:953, 2606:4700:20::ac43:46cb
Response IP 104.26.9.83
Found Yes
Hash 6c73f3bde61962d9db897bc722a557b1afdcff22dbf7808719ec8a6385f8d4bf
SimHash 0a02ca40e632

Groups

*

Rule Path
Disallow /publishing/*
Disallow /school/lessons_summary/*
Disallow /users/*
Disallow /html*
Disallow /*print/
Disallow /go.ph*
Disallow /doc/dis*
Disallow /google_search.html*
Disallow /guide/*
Disallow /*?
Allow /doc/*?

yandex

Rule Path
Disallow /publishing/*
Disallow /school/lessons_summary/*
Disallow /users/*
Disallow /html*
Disallow /*print/
Disallow /go.ph*
Disallow /doc/dis*
Disallow /google_search.html*
Disallow /guide/*
Disallow /*?
Allow /doc/*?

Other Records

Field Value
crawl-delay 3

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ru.osvita.ua/sitemapindex.xml
sitemap https://ru.osvita.ua/sitemapguide.xml

Comments

  • robots.txt for http://ru.osvita.ua

Warnings

  • `host` is not a known field.