daily.dialog.ua
robots.txt

Robots Exclusion Standard data for daily.dialog.ua

Resource Scan

Scan Details

Site Domain daily.dialog.ua
Base Domain dialog.ua
Scan Status Ok
Last Scan2025-05-15T23:30:52+00:00
Next Scan 2025-06-14T23:30:52+00:00

Last Scan

Scanned2025-05-15T23:30:52+00:00
URL https://daily.dialog.ua/robots.txt
Domain IPs 104.26.8.146, 104.26.9.146, 172.67.69.83, 2606:4700:20::681a:892, 2606:4700:20::681a:992, 2606:4700:20::ac43:4553
Response IP 104.26.9.146
Found Yes
Hash 17b0a0cdeb93807a54b2f4bc9090ee25b7971cce1026ed8285a217608069b2a8
SimHash 63059e726592

Groups

*

Rule Path
Disallow /admin/
Disallow /user/
Disallow /ajax/
Disallow *?page=*
Disallow *_page%3D*
Disallow *captcha?*
Disallow /allpolls
Disallow /search

Other Records

Field Value
sitemap https://daily.dialog.ua/sitemap.xml
sitemap https://daily.dialog.ua/sitemaps/daily_google_news.xml

Warnings

  • `host` is not a known field.