20.ua
robots.txt
Robots Exclusion Standard data for 20.ua
Resource Scan
Scan Details
Site Domain | 20.ua |
Base Domain | 20.ua |
Scan Status | Ok |
Last Scan | 2024-05-18T04:30:05+00:00 |
Next Scan | 2024-05-25T04:30:05+00:00 |
Last Scan
Scanned | 2024-05-18T04:30:05+00:00 |
URL | https://20.ua/robots.txt |
Redirect | https://top20.ua/robots.txt |
Redirect Domain | top20.ua |
Redirect Base | top20.ua |
Domain IPs | 31.41.220.94 |
Redirect IPs | 104.26.4.119, 104.26.5.119, 172.67.75.119, 2606:4700:20::681a:477, 2606:4700:20::681a:577, 2606:4700:20::ac43:4b77 |
Response IP | 104.26.4.119 |
Found | Yes |
Hash | 3092b5263767302861eefda8710efbdde9a0ffc0b0684f3bd4c6735b754f07d1 |
SimHash | 7c69610105e4 |
Groups
*
Rule | Path |
---|---|
Disallow | /goto/* |
Disallow | /ru/goto/* |
Disallow | /user_commment_row |
Disallow | /site_login |
Disallow | /company-favorite |
Disallow | /ru/company-favorite |
Disallow | /user_offer/new/* |
Disallow | /ru/user_offer/new/* |
Disallow | */redirect* |
Disallow | */user_commment_row |
Disallow | */company_rec* |
Disallow | */statistic/* |
Disallow | */goto_soc?* |
Disallow | /*utm_ |
Disallow | /goto/* |
Disallow | /ru/goto/* |
Disallow | /goto?* |
Disallow | /ru/goto?* |
Disallow | *test.20.ua* |
Disallow | */company_rec* |
Disallow | *increment_company_views/* |
Disallow | *?page= |
Disallow | *?_locale= |
Disallow | */chat/widget/* |
Disallow | */company/competitors* |
Disallow | */company-widget/* |
Disallow | */company-widget/* |
Disallow | */subcategory_filters* |
Disallow | */company/edit/* |
Disallow | */search/popular* |
Disallow | /tag_filters* |
Disallow | */web/dist/* |
Disallow | */what_peple_say/* |
Disallow | */api/search-query-track/* |
Disallow | */app.php/* |
Disallow | */logout* |
Disallow | /rss |
Disallow | /search? |
Disallow | *?schedule* |
Disallow | */tag_filters?tag* |
Disallow | *cdn-cgi/* |
Disallow | */pdf-view/* |
Other Records
Field | Value |
---|---|
sitemap | https://top20.ua/sitemap.xml |
Warnings
- `host` is not a known field.