vesti.ua
robots.txt
Robots Exclusion Standard data for vesti.ua
Resource Scan
Scan Details
| Site Domain | vesti.ua |
| Base Domain | vesti.ua |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-19T14:44:27+00:00 |
| Next Scan | 2024-06-18T14:44:27+00:00 |
Last Successful Scan
| Scanned | 2024-02-20T14:20:27+00:00 |
| URL | https://vesti.ua/robots.txt |
| Domain IPs | 104.26.4.185, 104.26.5.185, 172.67.73.54 |
| Response IP | 104.26.4.185 |
| Found | Yes |
| Hash | 8340fe48173f8b3c407d7bf6b4e5a91ab6a0f690f90acd034c21fa7996851639 |
| SimHash | 4b89d56422b7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_openstat |
| Disallow | /from%3Dadwords |
| Disallow | /utm_source |
| Disallow | /gclid%3D |
| Disallow | |
| Disallow | /search |
| Disallow | /publication |
| Disallow | /photo-gallery |
| Disallow | /video-gallery |
| Disallow | /content-statistics |
| Disallow | /intelli-user |
| Disallow | /blogging |
| Disallow | /poll/poll |
| Disallow | /core |
| Disallow | /page/page |
| Disallow | /ad/ad |
| Disallow | /categorization |
| Disallow | /sunsite/ |
| Disallow | /124075610/ |
| Disallow | /storage/ |
| Disallow | /view-tools/ |
| Disallow | /biznes-vesti/ |
| Disallow | /user/ |
| Disallow | /kiev/preview-349079-test-cross-0209 |
| Disallow | /wp-admin/ |
| Disallow | /preview |
| Disallow | /wp-json/ |
| Disallow | /?dataIndex= |
| Disallow | /trackback |
| Disallow | /replytocom%3D |
| Disallow | /attachment/ |
| Disallow | /img/article/ |
| Disallow | /img/gallery/ |
| Disallow | /?utm |
| Disallow | /?utm |
| Disallow | /?attachment |
| Disallow | /?e-mail= |
| Disallow | /authorization |
| Disallow | /search/ |
| Disallow | /?s |
| Disallow | /?s |
| Disallow | /?s= |
| Allow | /wp-content/themes/vesti/js/ |
| Allow | /wp-content/themes/vesti/css/ |
| Allow | /wp-content/themes/vesti/css/font/ |
| Allow | /wp-content/themes/vesti/images/ |
| Allow | /wp-content/uploads/ |
| Allow | /img/forall/ |
| Allow | /feeds/yandex-zen |
| Allow | /feeds/google-news |
| Allow | /feeds/yandex-turbo |
| Allow | /feeds/yandex-novosti |
| Allow | /feeds/google-sitemap |
yandex
| Rule | Path |
|---|---|
| Disallow | /_openstat |
| Disallow | /from%3Dadwords |
| Disallow | /utm_source |
| Disallow | /gclid%3D |
| Disallow | |
| Disallow | /search |
| Disallow | /publication |
| Disallow | /photo-gallery |
| Disallow | /video-gallery |
| Disallow | /content-statistics |
| Disallow | /intelli-user |
| Disallow | /blogging |
| Disallow | /poll/poll |
| Disallow | /core |
| Disallow | /page/page |
| Disallow | /ad/ad |
| Disallow | /categorization |
| Disallow | /sunsite/ |
| Disallow | /actions/ |
| Disallow | /124075610/ |
| Disallow | /storage/ |
| Disallow | /view-tools/ |
| Disallow | /biznes-vesti/ |
| Disallow | /user/ |
| Disallow | /kiev/preview-349079-test-cross-0209 |
| Disallow | /wp-admin/ |
| Disallow | /preview |
| Disallow | /wp-json/ |
| Disallow | /?dataIndex= |
| Disallow | /trackback |
| Disallow | /replytocom%3D |
| Disallow | /attachment/ |
| Disallow | /img/article/ |
| Disallow | /img/gallery/ |
| Disallow | /?utm |
| Disallow | /?utm |
| Disallow | /?attachment |
| Disallow | /?e-mail= |
| Disallow | /authorization |
| Disallow | /search/ |
| Disallow | /?s |
| Disallow | /?s |
| Disallow | /?s=* |
| Allow | /wp-content/themes/vesti/js/ |
| Allow | /wp-content/themes/vesti/css/ |
| Allow | /wp-content/themes/vesti/css/font/ |
| Allow | /wp-content/themes/vesti/images/ |
| Allow | /wp-content/uploads/ |
| Allow | /img/forall/ |
| Allow | /feeds/yandex-zen |
| Allow | /feeds/google-news |
| Allow | /feeds/yandex-turbo |
| Allow | /feeds/yandex-novosti |
| Allow | /feeds/google-sitemap |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vesti.ua/sitemap.xml |
| sitemap | https://vesti.ua/uk/sitemap.xml |
| sitemap | https://vesti.ua/feeds/google-sitemap |
Warnings
- 2 invalid lines.
- `host` is not a known field.