20minut.ua
robots.txt
Robots Exclusion Standard data for 20minut.ua
Resource Scan
Scan Details
| Site Domain | 20minut.ua |
| Base Domain | 20minut.ua |
| Scan Status | Ok |
| Last Scan | 2024-05-15T06:18:10+00:00 |
| Next Scan | 2024-05-22T06:18:10+00:00 |
Last Scan
| Scanned | 2024-05-15T06:18:10+00:00 |
| URL | https://20minut.ua/robots.txt |
| Redirect | https://vn.20minut.ua/robots.txt |
| Redirect Domain | vn.20minut.ua |
| Redirect Base | 20minut.ua |
| Domain IPs | 104.21.73.172, 172.67.164.77, 2606:4700:3030::6815:49ac, 2606:4700:3036::ac43:a44d |
| Redirect IPs | 104.21.73.172, 172.67.164.77, 2606:4700:3030::6815:49ac, 2606:4700:3036::ac43:a44d |
| Response IP | 104.21.73.172 |
| Found | Yes |
| Hash | 797aa63e9fe169eefe4143f2f1983fe92be71b4b2b64bd99cbd80e902bec11ee |
| SimHash | 34917bb84892 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*Vid-Chytachiv* |
| Disallow | /m/mnews* |
| Disallow | /export/menu |
| Disallow | /export/informers/news |
| Disallow | /search?query= |
| Disallow | /news_by_interests |
| Disallow | /filelib |
| Disallow | /mp3 |
| Disallow | /biblio/ |
| Disallow | /ads/* |
| Disallow | /ads_small/* |
| Disallow | /peel_banner/* |
| Disallow | /*page%3D |
| Disallow | */admin/* |
| Disallow | /goto/* |
| Disallow | /commentsFOSTest |
| Disallow | /sendlettertoauthor |
| Disallow | /ads_tracking |
| Disallow | /authorization/token/* |
| Disallow | /check_banners |
| Disallow | /ajax/updatepdfstatistics |
| Disallow | /participant* |
| Disallow | /competition/update_views |
| Disallow | /niceditor/upload |
| Disallow | /pulls* |
| Disallow | /shareSocial |
| Disallow | /testing |
| Disallow | /attach/remove |
| Disallow | /comment* |
| Disallow | /user* |
| Disallow | /login |
| Disallow | /newslist |
| Disallow | |
| Disallow | /*_add* |
| Disallow | /edit* |
| Disallow | /logout |
| Disallow | */get_views/* |
| Disallow | /authorposts?author_id |
| Disallow | /app.php |
| Disallow | /site_login/ |
| Disallow | /home_ajax/lazy_load |
| Disallow | /cdn-cgi/ |
| Disallow | /search/tab_news |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vn.20minut.ua/sitemap.xml |
| sitemap | https://vn.20minut.ua/sitemaps_vn_dayly.xml.gz |
Warnings
- `host` is not a known field.