finmarket.ru
robots.txt

Robots Exclusion Standard data for finmarket.ru

Resource Scan

Scan Details

Site Domain finmarket.ru
Base Domain finmarket.ru
Scan Status Ok
Last Scan2024-09-28T17:12:32+00:00
Next Scan 2024-10-05T17:12:32+00:00

Last Scan

Scanned2024-09-28T17:12:32+00:00
URL https://finmarket.ru/robots.txt
Redirect https://www.finmarket.ru/robots.txt
Redirect Domain www.finmarket.ru
Redirect Base finmarket.ru
Domain IPs 46.28.17.61
Redirect IPs 46.28.17.61
Response IP 46.28.17.61
Found Yes
Hash 868187564abea56f4c7880e32112e10aa18162a00ecad9043aef16ff2e37aa54
SimHash cbabae528b20

Groups

yandex

Rule Path
Disallow /config/
Disallow /system/
Disallow /x/
Disallow /X/
Disallow /ac/
Disallow /AC/
Disallow /actx/
Disallow /adm/
Disallow /Adm/
Disallow /ADM/
Disallow /ds/
Disallow /ftproot/
Disallow /inc/
Disallow /rcl/
Disallow /Rcl/
Disallow /RCL/
Disallow /rclstat/
Disallow /RclStat/
Disallow /security/
Disallow /srvs/
Disallow /test/
Disallow /errors/
Disallow /charts/
Disallow *tp%3D
Disallow /archive/?srch=

google

Rule Path
Disallow /config/
Disallow /system/
Disallow /x/
Disallow /X/
Disallow /ac/
Disallow /AC/
Disallow /actx/
Disallow /adm/
Disallow /Adm/
Disallow /ADM/
Disallow /ds/
Disallow /ftproot/
Disallow /inc/
Disallow /rcl/
Disallow /Rcl/
Disallow /RCL/
Disallow /rclstat/
Disallow /RclStat/
Disallow /security/
Disallow /srvs/
Disallow /test/
Disallow /errors/
Disallow /charts/
Disallow *tp%3D
Disallow /archive/?srch=

Other Records

Field Value
crawl-delay 0.5

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.