rusprofile.ru
robots.txt

Robots Exclusion Standard data for rusprofile.ru

Resource Scan

Scan Details

Site Domain rusprofile.ru
Base Domain rusprofile.ru
Scan Status Ok
Last Scan2024-05-25T10:55:40+00:00
Next Scan 2024-06-08T10:55:40+00:00

Last Scan

Scanned2024-05-25T10:55:40+00:00
URL https://www.rusprofile.ru/robots.txt
Domain IPs 62.109.21.200, 62.109.24.127, 82.146.55.15
Response IP 62.109.24.127
Found Yes
Hash d69fd1e7b42764f050d7f17c264eadcdcec5c3bf63356fbbe9d4702eb3917dfb
SimHash e656b52ef714

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /requisites
Disallow /founders
Disallow /accounting
Disallow /connections
Disallow /arbitr
Disallow /gz
Disallow /fssp
Disallow /inspections
Disallow /licenses
Disallow /branches
Disallow /history
Disallow /egrul
Disallow /egrip
Disallow /search
Disallow /personal
Disallow /taxes
Disallow /s/
Disallow /*print%3D*
Disallow /survey/*
Disallow /ajax.php*
Disallow /competitors
Disallow /contractors
Disallow /finance
Disallow /reliability
Disallow /business*ogrn%3D
Disallow /demo
Disallow /search-advanced
Disallow /subscribe-new-tariffs
Disallow /subscribe-new-prices/pro
Disallow /subscribe-new-prices/light
Disallow /bankruptcy
Disallow /*?ogrn=
Disallow /tagline
Disallow /storage
Disallow /docs
Disallow /pmep
Disallow /cpo
Disallow /trademarks
Disallow /leasing
Disallow /person/*/ceo
Disallow /person/*/founder
Disallow /person/*/reliability
Disallow /person/*/connections
Allow /s/*.png
Allow /egrul-fns

yandexbot

Rule Path
Disallow /requisites
Disallow /founders
Disallow /accounting
Disallow /connections
Disallow /arbitr
Disallow /gz
Disallow /fssp
Disallow /inspections
Disallow /licenses
Disallow /branches
Disallow /history
Disallow /okved
Disallow /egrul
Disallow /egrip
Disallow /search
Disallow /personal
Disallow /taxes
Disallow /s/
Disallow /*print%3D*
Disallow /survey/*
Disallow /ajax.php*
Disallow /competitors
Disallow /contractors
Disallow /finance
Disallow /reliability
Disallow /business*ogrn%3D
Disallow /demo
Disallow /search-advanced
Disallow /subscribe-new-tariffs
Disallow /subscribe-new-prices/pro
Disallow /subscribe-new-prices/light
Disallow /bankruptcy
Disallow /*?ogrn=
Disallow /tagline
Disallow /storage
Disallow /docs
Disallow /pmep
Disallow /cpo
Disallow /trademarks
Disallow /person/*/ceo
Disallow /person/*/founder
Disallow /person/*/reliability
Disallow /person/*/connections
Disallow /leasing
Allow /s/*.png
Allow /egrul-fns

msnbot

Rule Path
Disallow /leasing

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Disallow /leasing

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.rusprofile.ru/sitemap_https.xml

Warnings

  • `clean-param` is not a known field.