top20.ua
robots.txt
Robots Exclusion Standard data for top20.ua
Resource Scan
Scan Details
| Site Domain | top20.ua |
| Base Domain | top20.ua |
| Scan Status | Ok |
| Last Scan | 2024-11-18T07:48:07+00:00 |
| Next Scan | 2024-11-25T07:48:07+00:00 |
Last Scan
| Scanned | 2024-11-18T07:48:07+00:00 |
| URL | https://top20.ua/robots.txt |
| Domain IPs | 104.26.4.119, 104.26.5.119, 172.67.75.119, 2606:4700:20::681a:477, 2606:4700:20::681a:577, 2606:4700:20::ac43:4b77 |
| Response IP | 104.26.5.119 |
| Found | Yes |
| Hash | 0746e283be3361aacbcf719729d1af657c8349620d1d17900abe899ca1482a2c |
| SimHash | 7c796d0105e4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /goto/* |
| Disallow | /ru/goto/* |
| Disallow | /user_commment_row |
| Disallow | /site_login |
| Disallow | /company-favorite |
| Disallow | /ru/company-favorite |
| Disallow | /user_offer/new/* |
| Disallow | /ru/user_offer/new/* |
| Disallow | */redirect* |
| Disallow | */user_commment_row |
| Disallow | */company_rec* |
| Disallow | */statistic/* |
| Disallow | */goto_soc?* |
| Disallow | /*utm_ |
| Disallow | /goto/* |
| Disallow | /ru/goto/* |
| Disallow | /goto?* |
| Disallow | /ru/goto?* |
| Disallow | *test.20.ua* |
| Disallow | *img.top20.ua* |
| Disallow | */company_rec* |
| Disallow | *increment_company_views/* |
| Disallow | *?page= |
| Disallow | *?_locale= |
| Disallow | */chat/widget/* |
| Disallow | */company/competitors* |
| Disallow | */company-widget/* |
| Disallow | */company-widget/* |
| Disallow | */subcategory_filters* |
| Disallow | */company/edit/* |
| Disallow | */search/popular* |
| Disallow | /tag_filters* |
| Disallow | */web/dist/* |
| Disallow | */what_peple_say/* |
| Disallow | */api/search-query-track/* |
| Disallow | */app.php/* |
| Disallow | */logout* |
| Disallow | /rss |
| Disallow | /search? |
| Disallow | *?schedule* |
| Disallow | */tag_filters?tag* |
| Disallow | *cdn-cgi/* |
| Disallow | */pdf-view/* |
| Disallow | *.amp |
| Disallow | /localmap/ |
| Disallow | /user-attributes/fingerprint |
Other Records
| Field | Value |
|---|---|
| sitemap | https://top20.ua/sitemap.xml |
Warnings
- `host` is not a known field.