vstup.osvita.ua
robots.txt

Robots Exclusion Standard data for vstup.osvita.ua

Resource Scan

Scan Details

Site Domain vstup.osvita.ua
Base Domain osvita.ua
Scan Status Ok
Last Scan2024-05-26T21:04:57+00:00
Next Scan 2024-06-25T21:04:57+00:00

Last Scan

Scanned2024-05-26T21:04:57+00:00
URL https://vstup.osvita.ua/robots.txt
Domain IPs 104.26.8.83, 104.26.9.83, 172.67.70.203, 2606:4700:20::681a:853, 2606:4700:20::681a:953, 2606:4700:20::ac43:46cb
Response IP 104.26.9.83
Found Yes
Hash ebdf844e28c9c17a104401a42623c1e9709cbfb0312b3b45c5e8e2a6915438e8
SimHash 439acae36c32

Groups

*

Rule Path
Disallow /users*
Disallow /ap*
Disallow /y2018/y*
Disallow /y2019/y*
Disallow /y2020/y*
Disallow /y2021/y*
Disallow /y2022/y*
Disallow /y2023/y*
Disallow /y2024/y*
Disallow /y20*/?
Disallow /r*/?
Allow /users*

yandex

Rule Path
Disallow /users*
Disallow /ap*
Disallow /y2018/y*
Disallow /y2019/y*
Disallow /y2020/y*
Disallow /y2021/y*
Disallow /y2022/y*
Disallow /y2023/y*
Disallow /y2024/y*
Disallow /y20*/?
Disallow /r*/?

Other Records

Field Value
crawl-delay 2

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://vstup.osvita.ua/sitemapvstupindex.xml

Comments

  • robots.txt for server 1 https://vstup.osvita.ua

Warnings

  • `host` is not a known field.