rmnt.ru
robots.txt

Robots Exclusion Standard data for rmnt.ru

Resource Scan

Scan Details

Site Domain rmnt.ru
Base Domain rmnt.ru
Scan Status Ok
Last Scan2025-04-26T06:53:49+00:00
Next Scan 2025-05-26T06:53:49+00:00

Last Scan

Scanned2025-04-26T06:53:49+00:00
URL https://rmnt.ru/robots.txt
Redirect https://www.rmnt.ru/robots.txt
Redirect Domain www.rmnt.ru
Redirect Base rmnt.ru
Domain IPs 84.201.155.188
Redirect IPs 84.201.155.188
Response IP 84.201.155.188
Found Yes
Hash c4b7657d98131e8f0484678414d14622e103ac72ce4a2c8ac89fba712e7b4905
SimHash 426f19409727

Groups

yandex

Rule Path
Disallow /login/
Disallow /register/
Disallow /rotator
Disallow /rot
Disallow /rot20
Disallow /smotri
Disallow /cgi-bin/catalog
Disallow /search
Disallow /catalog/search
Disallow /advego
Disallow /oknatut
Disallow /go.php
Disallow /?URL=
Disallow /docs/*/news/
Disallow /docs/*/docs
Disallow /docs/*/firms
Disallow /firms/new
Disallow /shops/search/
Disallow /pub2/*/*/*.jpg
Disallow /pub2/*/*/*.jpeg
Disallow /pub2/*/*/*.png
Disallow /pub2/*/*/*.gif
Disallow /pictures/
Allow /i/
Allow /css/
Allow /js/

googlebot

Rule Path
Disallow /login/
Disallow /register/
Disallow /rotator
Disallow /rot
Disallow /rot20
Disallow /smotri
Disallow /cgi-bin/catalog
Disallow /search
Disallow /catalog/search
Disallow /advego
Disallow /oknatut
Disallow /go.php
Disallow /?URL=
Disallow /docs/*/news/
Disallow /docs/*/docs
Disallow /docs/*/firms
Disallow /firms/new
Disallow /shops/search/
Disallow /pub2/*/*/*.jpg
Disallow /pub2/*/*/*.jpeg
Disallow /pub2/*/*/*.png
Disallow /pub2/*/*/*.gif
Disallow /pictures/
Allow /i/
Allow /css/
Allow /js/

*

Rule Path
Disallow /login/
Disallow /register/
Disallow /rotator
Disallow /rot
Disallow /rot20
Disallow /smotri
Disallow /cgi-bin/catalog
Disallow /search
Disallow /catalog/search
Disallow /advego
Disallow /oknatut
Disallow /go.php
Disallow /?URL=
Disallow /docs/*/news/
Disallow /docs/*/docs
Disallow /docs/*/firms
Disallow /shops/search/
Disallow /firms/new
Disallow /pub2/*/*/*.jpg
Disallow /pub2/*/*/*.jpeg
Disallow /pub2/*/*/*.png
Disallow /pub2/*/*/*.gif
Disallow /pictures/
Allow /i/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 1.0

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

grapeshot

Rule Path
Disallow /

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /

riddler (http://riddler.io/about)

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rmnt.ru/sitemapindex.xml

Warnings

  • `host` is not a known field.