sostav.ru
robots.txt

Robots Exclusion Standard data for sostav.ru

Resource Scan

Scan Details

Site Domain sostav.ru
Base Domain sostav.ru
Scan Status Ok
Last Scan2026-02-09T07:05:24+00:00
Next Scan 2026-03-11T07:05:24+00:00

Last Scan

Scanned2026-02-09T07:05:24+00:00
URL https://sostav.ru/robots.txt
Redirect https://www.sostav.ru/robots.txt
Redirect Domain www.sostav.ru
Redirect Base sostav.ru
Domain IPs 185.71.67.130
Redirect IPs 185.71.67.130
Response IP 185.71.67.130
Found Yes
Hash 90c2d0e2049417481f82b629d41e1ac6f8f271c0f1b015ca2fbe587d376fa56a
SimHash 43f09616c340

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /screen
Disallow /level2
Disallow /resurs
Disallow /index
Disallow /level3
Disallow /forum
Disallow /game
Disallow /statia
Disallow /news/date
Disallow /news/all
Disallow /messages
Disallow /catalog
Disallow /kongress
Disallow /vlad
Disallow /frames
Disallow /chat
Disallow /admin
Disallow /print
Disallow /columns/tender
Disallow /job/newResume
Disallow /job/newVacance
Disallow /job/editVacance
Disallow /job/editResume
Disallow /job/searchResume
Disallow /job/searchVacance
Disallow /conf
Disallow /user
Disallow /prints
Disallow /search
Disallow /articles/rus/2007/columns/cannes2007/movies
Disallow /multimedia/video
Disallow /video
Disallow /shop/basket.php
Disallow /advertising/images
Disallow /blogs/webServices
Disallow /blogsWebServices
Disallow /banners
Disallow /league
Disallow /btl_project
Disallow /cross_auth/
Disallow /admin2/
Disallow /admintools/
Disallow /admintoolz/
Disallow /financical/
Disallow /app/dev/
Disallow /blogs2/
Disallow /blogs/admin/
Disallow /*%26
Disallow */%26

yandex

Rule Path
Disallow /cgi-bin/
Disallow /screen
Disallow /level2
Disallow /resurs
Disallow /index
Disallow /level3
Disallow /forum
Disallow /game
Disallow /statia
Disallow /news/date
Disallow /news/all
Disallow /messages
Disallow /catalog
Disallow /kongress
Disallow /vlad
Disallow /frames
Disallow /chat
Disallow /admin
Disallow /print
Disallow /columns/tender
Disallow /job/newResume
Disallow /job/newVacance
Disallow /job/editVacance
Disallow /job/editResume
Disallow /job/searchResume
Disallow /job/searchVacance
Disallow /conf
Disallow /user
Disallow /prints
Disallow /search
Disallow /articles/rus/2007/columns/cannes2007/movies
Disallow /multimedia/video
Disallow /video
Disallow /shop/basket.php
Disallow /advertising/images
Disallow /blogs/webServices
Disallow /blogsWebServices
Disallow /banners
Disallow /league
Disallow /btl_project
Disallow /cross_auth/
Disallow /admin2/
Disallow /admintools/
Disallow /admintoolz/
Disallow /financical/
Disallow /app/dev/
Disallow /blogs2/
Disallow /blogs/admin/
Disallow /*%26
Disallow */%26

twitterbot

Rule Path
Allow /
Allow /assets/spec/

yandexnews

Rule Path
Allow /rss/yandex
Allow /assets/spec/

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.sostav.ru/sitemap_index.xml

Comments

  • Disallow: /banner
  • Disallow: /banner

Warnings

  • `host` is not a known field.