komiinform.ru
robots.txt

Robots Exclusion Standard data for komiinform.ru

Resource Scan

Scan Details

Site Domain komiinform.ru
Base Domain komiinform.ru
Scan Status Ok
Last Scan2024-05-25T03:32:03+00:00
Next Scan 2024-06-01T03:32:03+00:00

Last Scan

Scanned2024-05-25T03:32:03+00:00
URL https://komiinform.ru/robots.txt
Domain IPs 104.21.55.5, 172.67.170.5, 2606:4700:3032::6815:3705, 2606:4700:3033::ac43:aa05
Response IP 172.67.170.5
Found Yes
Hash 7ff01389cb9af20517a2290ad890d0ea3e34c4f697d4acd0016d96c7d31ae97b
SimHash 3c648f434731

Groups

*
yandexnews

Rule Path
Allow /rss/rss.xml
Disallow /admin
Disallow /news/id
Disallow /rklm-cl
Disallow /content/partner
Disallow /news_types
Disallow /congratulations
Disallow /print
Disallow /cabinet
Disallow /search?*
Disallow /find?*
Disallow /services/docs*
Disallow /?*
Disallow /*.pdf$
Disallow */blind
Disallow /*_blind
Disallow /visit/*

Warnings

  • `host` is not a known field.