propartner.ru
robots.txt

Robots Exclusion Standard data for propartner.ru

Resource Scan

Scan Details

Site Domain propartner.ru
Base Domain propartner.ru
Scan Status Ok
Last Scan2024-09-25T22:43:50+00:00
Next Scan 2024-10-25T22:43:50+00:00

Last Scan

Scanned2024-09-25T22:43:50+00:00
URL https://propartner.ru/robots.txt
Redirect https://www.propartner.ru/robots.txt
Redirect Domain www.propartner.ru
Redirect Base propartner.ru
Domain IPs 92.38.128.246, 92.38.128.27
Redirect IPs 92.38.128.246, 92.38.128.27
Response IP 92.38.128.27
Found Yes
Hash b3d7f140d099a38c9eb619e607bb4b2eabb4f67978a861b83ff27285e5a58052
SimHash 65b184706f14

Groups

*

Rule Path
Disallow /admin
Disallow /webstat
Disallow /modules
Disallow /js/seo_hide.js
Disallow /js/seo_hide.min.js
Disallow /user
Disallow /auth
Disallow /send_mess
Disallow /order_product
Disallow /go
Disallow /news
Disallow /print-offer
Disallow /print_pricelist
Disallow /pages/yandex-map.php
Disallow /correspondence
Disallow /search
Disallow /?to_auth
Disallow *list_prop_products*
Disallow /*?
Disallow /uploads_img/prop_suppliers
Disallow /catalog/go/*
Disallow /companies/*/my_company

bingbot
baiduspider
exabot
sogou
seekbot

Rule Path
Disallow /admin
Disallow /webstat
Disallow /modules
Disallow /js/seo_hide.js
Disallow /js/seo_hide.min.js
Disallow /user
Disallow /auth
Disallow /send_mess
Disallow /order_product
Disallow /go
Disallow /news
Disallow /print-offer
Disallow /print_pricelist
Disallow /pages/yandex-map.php
Disallow /correspondence
Disallow /search
Disallow /?to_auth
Disallow *list_prop_products*
Disallow /*?
Disallow /uploads_img/prop_suppliers
Disallow /catalog/go/*
Disallow /companies/*/my_company

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Disallow /admin
Disallow /webstat
Disallow /modules
Disallow /js/seo_hide.js
Disallow /js/seo_hide.min.js
Disallow /user
Disallow /auth
Disallow /send_mess
Disallow /order_product
Disallow /go
Disallow /news
Disallow /print-offer
Disallow /print_pricelist
Disallow /pages/yandex-map.php
Disallow /correspondence
Disallow /search
Disallow /?to_auth
Disallow *list_prop_products*
Disallow /*?
Disallow /uploads_img/prop_suppliers
Disallow /catalog/go/*
Disallow /companies/*/my_company

Other Records

Field Value
crawl-delay 1

mail.ru

Rule Path
Disallow /admin
Disallow /webstat
Disallow /modules
Disallow /js/seo_hide.js
Disallow /js/seo_hide.min.js
Disallow /user
Disallow /auth
Disallow /send_mess
Disallow /order_product
Disallow /go
Disallow /news
Disallow /print-offer
Disallow /print_pricelist
Disallow /pages/yandex-map.php
Disallow /correspondence
Disallow /search
Disallow /?to_auth
Disallow *list_prop_products*
Disallow /*?
Disallow /uploads_img/prop_suppliers
Disallow /catalog/go/*
Disallow /companies/*/my_company

Other Records

Field Value
crawl-delay 1

Warnings

  • `host` is not a known field.