glavcom.ua
robots.txt

Robots Exclusion Standard data for glavcom.ua

Resource Scan

Scan Details

Site Domain glavcom.ua
Base Domain glavcom.ua
Scan Status Ok
Last Scan2024-11-09T02:50:58+00:00
Next Scan 2024-11-16T02:50:58+00:00

Last Scan

Scanned2024-11-09T02:50:58+00:00
URL https://glavcom.ua/robots.txt
Domain IPs 104.22.0.55, 104.22.1.55, 172.67.37.28, 2606:4700:10::6816:137, 2606:4700:10::6816:37, 2606:4700:10::ac43:251c
Response IP 104.22.0.55
Found Yes
Hash ac1da340c443f46189caf4da75a0fa1b5b5b8cab23339e95460a89382503fa7c
SimHash 630481e2cf35

Groups

*

Rule Path
Disallow /exec
Disallow /sunsite/
Disallow /search*
Disallow /preview
Disallow /actions/
Disallow /*/archive/
Disallow /*/archive.html
Disallow */videoarchive/*
Disallow */pub/pdf/*
Disallow */ftp_upload/iframe/*
Allow /.js?
Allow /*.css?
Allow /*.jpg?
Allow /*.jpeg?
Allow /*.webp?
Allow /*.gif?
Allow /*.png?

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://glavcom.ua/pub/sitemaps/sitemap_index.xml
sitemap https://glavcom.ua/pub/sitemaps/sitemap-news.xml

Comments

  • Disallow: *?