Log In Sign Up

krovmarket.ru
robots.txt

Robots Exclusion Standard data for krovmarket.ru

Resource Scan

Scan Details

Site Domain krovmarket.ru
Base Domain krovmarket.ru
Scan Status Ok
Last Scan2025-04-01T10:24:09+00:00
Next Scan 2025-05-01T10:24:09+00:00

Last Scan

Scanned2025-04-01T10:24:09+00:00
URL https://krovmarket.ru/robots.txt
Redirect https://www.krovmarket.ru/robots.txt
Redirect Domain www.krovmarket.ru
Redirect Base krovmarket.ru
Domain IPs 104.21.92.125, 172.67.193.73, 2606:4700:3031::ac43:c149, 2606:4700:3034::6815:5c7d
Redirect IPs 104.21.92.125, 172.67.193.73, 2606:4700:3031::ac43:c149, 2606:4700:3034::6815:5c7d
Response IP 104.21.92.125
Found Yes
Hash 1be2a2092242b4f4c6edb5cdec4c63943432d79465417731ca1daef53d42f163
SimHash 44b38a416395

Groups

*

Rule Path
Allow /derevyannye-doma/proekty-derevyannykh-domov/*PAGEN_1
Allow /derevyannye-doma/kombinirovannye-doma/*PAGEN_1
Allow /derevyannye-doma/doma-iz-otsilindrovannogo-brevna/*PAGEN_1
Allow /derevyannye-doma/brus/*PAGEN_1
Allow /derevyannye-doma/doma-iz-kleennogo-brusa/*PAGEN_1
Allow /o-kompanii/nashi-raboty/*PAGEN_1
Allow /o-kompanii/nashi-raboty/?SECTION_ID=346*PAGEN_1
Allow /o-kompanii/nashi-raboty/?SECTION_ID=345*PAGEN_1
Allow /o-kompanii/polezno-znat/*PAGEN_1
Allow /stati/*PAGEN_1
Allow /news/*PAGEN_1
Disallow /*PAGEN*
Disallow /*?
Disallow /test/
Disallow /testtest/
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow *.pdf
Disallow *.xls
Disallow *?sort
Disallow *%26amp
Disallow *?escaped_fragment=
Disallow *?SHOWALL
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=345
Disallow /*?__cf_chl*

yandex

Rule Path
Allow /derevyannye-doma/proekty-derevyannykh-domov/*PAGEN_1
Allow /derevyannye-doma/kombinirovannye-doma/*PAGEN_1
Allow /derevyannye-doma/doma-iz-otsilindrovannogo-brevna/*PAGEN_1
Allow /derevyannye-doma/brus/*PAGEN_1
Allow /derevyannye-doma/doma-iz-kleennogo-brusa/*PAGEN_1
Allow /o-kompanii/nashi-raboty/?PAGEN_1
Allow /o-kompanii/nashi-raboty/?SECTION_ID=346*PAGEN_1
Allow /o-kompanii/nashi-raboty/?SECTION_ID=345*PAGEN_1
Allow /o-kompanii/polezno-znat/*PAGEN_1
Allow /stati/*PAGEN_1
Allow /news/*PAGEN_1
Disallow /*PAGEN*
Disallow /*?
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?yclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow *.pdf
Disallow *.xls
Disallow *?sort
Disallow *%26
Disallow *?SHOWALL
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=345
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=346
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=0

googlebot

Rule Path
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?yclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow *.pdf
Disallow *.xls
Disallow /*?
Disallow *?sort
Disallow *%26
Disallow *?SHOWALL
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=345
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=346
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=0

bingbot

Rule Path
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?yclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow *.pdf
Disallow *.xls
Disallow /*?
Disallow *?sort
Disallow *%26amp
Disallow *?SHOWALL
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=345
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=346
Disallow /o-kompanii/nashi-raboty/?SECTION_ID=0

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.krovmarket.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top