roseltorg.ru
robots.txt

Robots Exclusion Standard data for roseltorg.ru

Resource Scan

Scan Details

Site Domain roseltorg.ru
Base Domain roseltorg.ru
Scan Status Ok
Last Scan2024-10-30T19:11:57+00:00
Next Scan 2024-11-29T19:11:57+00:00

Last Scan

Scanned2024-10-30T19:11:57+00:00
URL https://roseltorg.ru/robots.txt
Redirect https://www.roseltorg.ru/robots.txt
Redirect Domain www.roseltorg.ru
Redirect Base roseltorg.ru
Domain IPs 185.79.118.12
Redirect IPs 185.79.118.12
Response IP 185.79.118.12
Found Yes
Hash ff5dc80ad081767956c706f088b4d9908cb19f8b5c12743280294e054ebd88fd
SimHash 3096bd0b2b60

Groups

*

Rule Path
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /profiles/*.svg
Allow /procedures/search?page=
Allow /search/*?page=
Allow /about/news?page=
Allow /personal/*?page=
Allow /agro/*?page=
Disallow /search/*?
Disallow /about/news*?
Disallow /personal/*?
Disallow /agro/*?
Disallow /speed/upper_form
Disallow /edo/upper_form_edo
Disallow /tenderniy_zaim/upper_form
Disallow /core/
Disallow /profiles/
Disallow /README.txt
Disallow /web.config
Disallow /bgonline/
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /search/node/
Disallow /node/add/
Disallow /node/*
Disallow /warning/*
Disallow /user/register/
Disallow /user/password/
Disallow /user/login
Disallow /user/login/
Disallow /user/logout/
Disallow /index.php
Disallow /index.php/*
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips/
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password/
Disallow /index.php/user/register/
Disallow /index.php/user/login/
Disallow /index.php/user/logout/
Disallow /compliance/profile1
Disallow /taxonomy/term/*
Disallow /msp
Disallow /sale
Disallow /fkr
Disallow /com
Disallow /44fz
Disallow /eetp-graphic
Disallow /*?sc_src=
Disallow /*?stayhome
Disallow /*?_ga=
Disallow /compliance/request-app
Disallow /for-customers/upper_form
Disallow /new
Disallow /bgonline
Disallow /bg/express
Disallow /partners_eetp
Disallow /personal/www.zakupki.gov.ru
Disallow /personal/%D0%A4%D0%BE%D1%80%D0%BC%D0%B0%2520%D0%B4%D0%BB%D1%8F%2520%D0%B7%D0%B0%D0%BF%D0%BE%D0%BB%D0%BD%D0%B5%D0%BD%D0%B8%D1%8F
Disallow /ecp/your-app
Disallow /markirovka/upper-form
Disallow /ecp2
Disallow /ecp/kuc/upper_form
Disallow /ecp/become-partner-up-form
Disallow /ecp/partner-app
Disallow /ecp/map
Disallow /procedure/search/similar
Disallow /elektronnaya-podpis
Disallow /elektronnaya-popdis/map
Disallow /*?mindbox
Disallow /*?bx
Disallow /_flysystem/webdav/2023/06/23/fs_rp_finorganizacii.pdf

Other Records

Field Value
sitemap https://www.roseltorg.ru/sitemap.xml

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • CSS, JS, Images

Warnings

  • `clean-param` is not a known field.