dom-v-arendy.ru
robots.txt

Robots Exclusion Standard data for dom-v-arendy.ru

Resource Scan

Scan Details

Site Domain dom-v-arendy.ru
Base Domain dom-v-arendy.ru
Scan Status Ok
Last Scan2024-08-30T03:48:40+00:00
Next Scan 2024-09-29T03:48:40+00:00

Last Scan

Scanned2024-08-30T03:48:40+00:00
URL https://dom-v-arendy.ru/robots.txt
Domain IPs 87.236.16.26
Response IP 87.236.16.26
Found Yes
Hash 5a038b4e68fcb6915afc1261418f866d0179191269757bec54cfdd9b2f66c5e2
SimHash 4c59dfd28b37

Groups

*

Rule Path
Disallow /objects/$
Disallow /objects/*
Disallow /objects/?
Disallow /kottedzhi-na-sutki$
Disallow /kottedzhi-na-sutki?*
Disallow /kottedzhi-na-sutki/?*
Disallow /kottedzhi-na-mesjac$
Disallow /kottedzhi-na-mesjac?*
Disallow /kottedzhi-na-mesjac/?*
Disallow /special/
Disallow /turbazy$
Disallow /turbazy?*
Disallow /turbazy/?*
Disallow /polezno/*
Disallow /kottedji/*
Disallow /design/*
Disallow /mockup/*
Disallow /component/*
Disallow /kontakty/*
Disallow /yml-catalog*
Disallow /yandex-realty*
Disallow /update-*
Disallow *yclid%3D*
Disallow *ved%3D*
Disallow /?sort*

yandex

Rule Path
Disallow /yandex-realty*
Disallow /objects/$
Disallow /objects/*
Disallow /objects/?
Disallow /?yhid
Disallow /kottedzhi-na-sutki/?tv
Disallow /?sort*
Disallow *?*

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://dom-v-arendy.ru/samara_sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.