kuban.rbc.ru
robots.txt
Robots Exclusion Standard data for kuban.rbc.ru
Resource Scan
Scan Details
Site Domain | kuban.rbc.ru |
Base Domain | rbc.ru |
Scan Status | Ok |
Last Scan | 2024-11-04T15:09:06+00:00 |
Next Scan | 2024-11-11T15:09:06+00:00 |
Last Scan
Scanned | 2024-11-04T15:09:06+00:00 |
URL | https://kuban.rbc.ru/robots.txt |
Domain IPs | 185.72.229.4, 80.68.253.4 |
Response IP | 80.68.253.4 |
Found | Yes |
Hash | 178d15ef1fb10dc72b6018ffcfbd78007d3a350b476966ea35844b25bec355cf |
SimHash | 1d1aeaf1679a |
Groups
*
Rule | Path |
---|---|
Disallow | /*?q= |
Disallow | /search/ |
Disallow | /search?query= |
Disallow | /search?q= |
Disallow | /info-service/api/v2/ev/ |
Disallow | /cgi-bin/ |
Disallow | /search2/ |
Disallow | /include/ |
Disallow | /includes/ |
Disallow | *page* |
Disallow | /photoslider/ |
Disallow | /commercial-preview/ |
Disallow | /ajax/ |
Disallow | */search |
Disallow | */preview/ |
Disallow | /companies/amp/ogrn/11* |
Disallow | /companies/amp/ogrn/10* |
googlebot
Rule | Path |
---|---|
Disallow | /*?q= |
Disallow | /search/ |
Disallow | /search?query= |
Disallow | /search?q= |
Disallow | /info-service/api/v2/ev/ |
Disallow | /cgi-bin/ |
Disallow | /search2/ |
Disallow | /include/ |
Disallow | /includes/ |
Disallow | *page* |
Disallow | /commercial-preview/ |
Disallow | /ajax/ |
Disallow | */search |
Disallow | */preview/ |
Disallow | /companies/amp/ogrn/11* |
Disallow | /companies/amp/ogrn/10* |
yandex
Rule | Path |
---|---|
Disallow | /*?q= |
Disallow | /search/ |
Disallow | /search?query= |
Disallow | /search?q= |
Disallow | /info-service/api/v2/ev/ |
Disallow | /cgi-bin/ |
Disallow | /search2/ |
Disallow | /include/ |
Disallow | /includes/ |
Disallow | *page* |
Disallow | /photoslider/ |
Disallow | /commercial-preview/ |
Disallow | /ajax/ |
Disallow | */search |
Disallow | */preview/ |
Disallow | /companies/amp/ogrn/11* |
Disallow | /companies/amp/ogrn/10* |
Other Records
Field | Value |
---|---|
sitemap | https://kuban.rbc.ru/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.