kuban.rbc.ru
robots.txt

Robots Exclusion Standard data for kuban.rbc.ru

Resource Scan

Scan Details

Site Domain kuban.rbc.ru
Base Domain rbc.ru
Scan Status Ok
Last Scan2024-11-04T15:09:06+00:00
Next Scan 2024-11-11T15:09:06+00:00

Last Scan

Scanned2024-11-04T15:09:06+00:00
URL https://kuban.rbc.ru/robots.txt
Domain IPs 185.72.229.4, 80.68.253.4
Response IP 80.68.253.4
Found Yes
Hash 178d15ef1fb10dc72b6018ffcfbd78007d3a350b476966ea35844b25bec355cf
SimHash 1d1aeaf1679a

Groups

*

Rule Path
Disallow /*?q=
Disallow /search/
Disallow /search?query=
Disallow /search?q=
Disallow /info-service/api/v2/ev/
Disallow /cgi-bin/
Disallow /search2/
Disallow /include/
Disallow /includes/
Disallow *page*
Disallow /photoslider/
Disallow /commercial-preview/
Disallow /ajax/
Disallow */search
Disallow */preview/
Disallow /companies/amp/ogrn/11*
Disallow /companies/amp/ogrn/10*

googlebot

Rule Path
Disallow /*?q=
Disallow /search/
Disallow /search?query=
Disallow /search?q=
Disallow /info-service/api/v2/ev/
Disallow /cgi-bin/
Disallow /search2/
Disallow /include/
Disallow /includes/
Disallow *page*
Disallow /commercial-preview/
Disallow /ajax/
Disallow */search
Disallow */preview/
Disallow /companies/amp/ogrn/11*
Disallow /companies/amp/ogrn/10*

yandex

Rule Path
Disallow /*?q=
Disallow /search/
Disallow /search?query=
Disallow /search?q=
Disallow /info-service/api/v2/ev/
Disallow /cgi-bin/
Disallow /search2/
Disallow /include/
Disallow /includes/
Disallow *page*
Disallow /photoslider/
Disallow /commercial-preview/
Disallow /ajax/
Disallow */search
Disallow */preview/
Disallow /companies/amp/ogrn/11*
Disallow /companies/amp/ogrn/10*

Other Records

Field Value
sitemap https://kuban.rbc.ru/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.