kommersant.ru
robots.txt
Robots Exclusion Standard data for kommersant.ru
Resource Scan
Scan Details
| Site Domain | kommersant.ru |
| Base Domain | kommersant.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-07T18:04:45+00:00 |
| Next Scan | 2024-10-14T18:04:45+00:00 |
Last Scan
| Scanned | 2024-10-07T18:04:45+00:00 |
| URL | https://kommersant.ru/robots.txt |
| Redirect | https://www.kommersant.ru/robots.txt |
| Redirect Domain | www.kommersant.ru |
| Redirect Base | kommersant.ru |
| Domain IPs | 178.248.238.19 |
| Redirect IPs | 178.248.238.19 |
| Response IP | 178.248.238.19 |
| Found | Yes |
| Hash | 4e909d3c11d244a5a13c41ad30176974a148e8b743ecd131e46de9550c261625 |
| SimHash | bb4495457535 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /photo/buyphoto |
| Disallow | /rules |
| Disallow | /? |
| Disallow | /doc*%3D |
| Disallow | /*utm_ |
| Disallow | /*from%3D |
| Disallow | /*click_ |
| Disallow | /*captchaKey |
| Disallow | /lk |
| Disallow | /*search |
| Disallow | /*themeid%3D |
| Disallow | /doc-rss |
| Disallow | /Doc-rm |
| Disallow | /doc-rm |
| Disallow | /Doc-rss |
| Disallow | /Doc-y/ |
| Disallow | /doc-y/ |
| Disallow | /*title%3D |
| Disallow | /*pdocdenied |
| Disallow | /LK/NotAuthorized |
| Disallow | /archive/*?publishingId=152 |
| Disallow | /*_escaped_fragment_%3D |
| Disallow | /*fp%3D |
| Disallow | /*themeID%3D |
| Disallow | /*isSearch%3D |
| Disallow | /fencing?date= |
| Disallow | /spief?date |
| Disallow | /bankruptcy/*page%3D |
| Disallow | *?small_mozaic=* |
| Disallow | /authors/*page%3D |
| Disallow | /gbox/ |
| Disallow | /?trace=* |
| Disallow | /*?feed=* |
| Disallow | /classified |
| Disallow | /*%26sortColumn%3D* |
| Disallow | /*news?date=* |
| Disallow | /company_news |
| Disallow | /*?hc=* |
| Disallow | /*?pg=* |
| Disallow | *?publishingId=* |
| Disallow | /Daily/ |
| Disallow | /Vlast/ |
| Disallow | /Money/ |
| Disallow | /Autopilot/ |
| Disallow | /Apps/ |
| Disallow | /Weekend/ |
| Disallow | /Sf/ |
| Disallow | /Citizen_k/ |
| Disallow | /Ogoniok/ |
| Disallow | /Nauka/ |
| Disallow | /tema/ |
| Disallow | /FreeMoney/ |
| Disallow | /FreeVlast/ |
| Disallow | /reklama/ |
| Disallow | /library |
| Disallow | /livejournal |
| Disallow | /articles/ |
| Disallow | *twitter_impression* |
| Disallow | *doc.html* |
| Disallow | *IssueId* |
| Disallow | *NodesID* |
| Disallow | /pda/* |
| Disallow | *?intervaltype=* |
| Disallow | *%26pageprms* |
| Disallow | *?id2=* |
| Disallow | *?regionid=* |
| Allow | *?erid=* |
yandex
| Rule | Path |
|---|---|
| Disallow | /photo/buyphoto |
| Disallow | /rules |
| Disallow | /? |
| Disallow | /*utm_ |
| Disallow | /*from%3D |
| Disallow | /*click_ |
| Disallow | /*captchaKey |
| Disallow | /lk |
| Disallow | /*search |
| Disallow | /*themeid%3D |
| Disallow | /doc-rss |
| Disallow | /Doc-rm |
| Disallow | /doc-rm |
| Disallow | /Doc-rss |
| Disallow | /Doc-y/ |
| Disallow | /doc-y/ |
| Disallow | /*title%3D |
| Disallow | /*pdocdenied |
| Disallow | /LK/NotAuthorized |
| Disallow | /archive/*?publishingId=152 |
| Disallow | /*_escaped_fragment_%3D |
| Disallow | /*fp%3D |
| Disallow | /*themeID%3D |
| Disallow | /*isSearch%3D |
| Disallow | /fencing?date= |
| Disallow | /spief?date |
| Disallow | /bankruptcy/*page%3D |
| Disallow | *?small_mozaic=* |
| Disallow | /authors/*page%3D |
| Disallow | /gbox/ |
| Disallow | /?trace=* |
| Disallow | /*?feed=* |
| Disallow | /classified |
| Disallow | /*%26sortColumn%3D* |
| Disallow | /company_news |
| Disallow | /*?hc=* |
| Disallow | /*?pg=* |
| Disallow | *?publishingId=* |
| Disallow | /Daily/ |
| Disallow | /Vlast/ |
| Disallow | /Money/ |
| Disallow | /Autopilot/ |
| Disallow | /Apps/ |
| Disallow | /Weekend/ |
| Disallow | /Sf/ |
| Disallow | /Citizen_k/ |
| Disallow | /Ogoniok/ |
| Disallow | /Nauka/ |
| Disallow | /tema/ |
| Disallow | /FreeMoney/ |
| Disallow | /FreeVlast/ |
| Disallow | /reklama/ |
| Disallow | /library |
| Disallow | /livejournal |
| Disallow | /articles/ |
| Disallow | *twitter_impression* |
| Disallow | *doc.html* |
| Disallow | *IssueId* |
| Disallow | *NodesID* |
| Disallow | /pda/* |
| Disallow | *?intervaltype=* |
| Disallow | *%26pageprms* |
| Disallow | *?regionid=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.kommersant.ru/sitemaps/all_docs_sitemap.xml |
| sitemap | https://www.kommersant.ru/sitemaps/index_sitemap.xml |
| sitemap | https://www.kommersant.ru/sitemaps/news.xml |
| sitemap | https://www.kommersant.ru/sitemaps/authors.xml |
| sitemap | https://www.kommersant.ru/sitemaps/themes.xml |
Warnings
- `clean-param` is not a known field.