89.ru
robots.txt
Robots Exclusion Standard data for 89.ru
Resource Scan
Scan Details
Site Domain | 89.ru |
Base Domain | 89.ru |
Scan Status | Ok |
Last Scan | 2024-06-10T22:42:29+00:00 |
Next Scan | 2024-06-17T22:42:29+00:00 |
Last Scan
Scanned | 2024-06-10T22:42:29+00:00 |
URL | https://89.ru/robots.txt |
Domain IPs | 195.19.220.26 |
Response IP | 195.19.220.26 |
Found | Yes |
Hash | 24e9d3292249a332d7b14f56cc69f3afdef20304b9d8a75bc06a210483d4e78a |
SimHash | 1a145030c333 |
Groups
*
Rule | Path |
---|---|
Disallow | */search |
Disallow | */comments/ |
Disallow | /market/ |
Disallow | /feedback/ |
Disallow | /map/ |
Disallow | /gm-api/ |
Disallow | /quizzes/ |
Allow | /html-to-img/ |
Disallow | /help/ |
Disallow | /pages/ |
Disallow | /site_map/ |
Disallow | /passport/ |
Disallow | *page%3D1 |
Disallow | *discuss%3D |
Disallow | *full%3D |
Disallow | */?share |
Disallow | /? |
Disallow | */?ngs_token= |
Disallow | */?dateFrom= |
Disallow | */*%26dateFrom%3D |
Disallow | */?set_cookie= |
Disallow | /text/*/?page= |
Disallow | */?recordId= |
Disallow | *%26regionId%3D |
Disallow | *%26shareCard%3D |
Disallow | *?previewToken= |
Disallow | *?_ |
Disallow | *?google_preview= |
Disallow | *?_ym_debug= |
Disallow | */yanews/ |
Disallow | *?mindbox-message-key= |
Disallow | *?from= |
Disallow | *?utm_ |
Disallow | *?amp |
Disallow | *?rec= |
Disallow | *?etext= |
Disallow | *?startedAtGte= |
Disallow | *?place= |
Disallow | *?kids= |
Disallow | *?*free= |
Disallow | /afisha/all-events/ |
Disallow | /afisha/cinema-events/ |
Disallow | /afisha/concert-events/ |
Disallow | /afisha/theatre-events/ |
Disallow | /afisha/kids-events/ |
Disallow | /afisha/sport-events/ |
Disallow | /afisha/art-events/ |
Disallow | /afisha/other-events/ |
Other Records
Field | Value |
---|---|
sitemap | https://89.ru/sitemaps/index.xml.gz |
sitemap | https://89.ru/exchange/sitemap.xml |
Warnings
- `clean-param` is not a known field.
Comments