finmarket.ru
robots.txt
Robots Exclusion Standard data for finmarket.ru
Resource Scan
Scan Details
Site Domain | finmarket.ru |
Base Domain | finmarket.ru |
Scan Status | Ok |
Last Scan | 2024-11-09T17:44:21+00:00 |
Next Scan | 2024-11-16T17:44:21+00:00 |
Last Scan
Scanned | 2024-11-09T17:44:21+00:00 |
URL | https://finmarket.ru/robots.txt |
Redirect | https://www.finmarket.ru/robots.txt |
Redirect Domain | www.finmarket.ru |
Redirect Base | finmarket.ru |
Domain IPs | 46.28.17.61 |
Redirect IPs | 46.28.17.61 |
Response IP | 46.28.17.61 |
Found | Yes |
Hash | 868187564abea56f4c7880e32112e10aa18162a00ecad9043aef16ff2e37aa54 |
SimHash | cbabae528b20 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /config/ |
Disallow | /system/ |
Disallow | /x/ |
Disallow | /X/ |
Disallow | /ac/ |
Disallow | /AC/ |
Disallow | /actx/ |
Disallow | /adm/ |
Disallow | /Adm/ |
Disallow | /ADM/ |
Disallow | /ds/ |
Disallow | /ftproot/ |
Disallow | /inc/ |
Disallow | /rcl/ |
Disallow | /Rcl/ |
Disallow | /RCL/ |
Disallow | /rclstat/ |
Disallow | /RclStat/ |
Disallow | /security/ |
Disallow | /srvs/ |
Disallow | /test/ |
Disallow | /errors/ |
Disallow | /charts/ |
Disallow | *tp%3D |
Disallow | /archive/?srch= |
google
Rule | Path |
---|---|
Disallow | /config/ |
Disallow | /system/ |
Disallow | /x/ |
Disallow | /X/ |
Disallow | /ac/ |
Disallow | /AC/ |
Disallow | /actx/ |
Disallow | /adm/ |
Disallow | /Adm/ |
Disallow | /ADM/ |
Disallow | /ds/ |
Disallow | /ftproot/ |
Disallow | /inc/ |
Disallow | /rcl/ |
Disallow | /Rcl/ |
Disallow | /RCL/ |
Disallow | /rclstat/ |
Disallow | /RclStat/ |
Disallow | /security/ |
Disallow | /srvs/ |
Disallow | /test/ |
Disallow | /errors/ |
Disallow | /charts/ |
Disallow | *tp%3D |
Disallow | /archive/?srch= |
Other Records
Field | Value |
---|---|
crawl-delay | 0.5 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.