cfin.ru
robots.txt
Robots Exclusion Standard data for cfin.ru
Resource Scan
Scan Details
| Site Domain | cfin.ru |
| Base Domain | cfin.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-28T18:22:05+00:00 |
| Next Scan | 2024-10-28T18:22:05+00:00 |
Last Scan
| Scanned | 2024-09-28T18:22:05+00:00 |
| URL | https://cfin.ru/robots.txt |
| Domain IPs | 87.236.19.192 |
| Response IP | 87.236.19.192 |
| Found | Yes |
| Hash | 2d744f2080d079a9092e09ef927e2425fc003c6f6c4aaec797ba931922bb8874 |
| SimHash | 5da8184152b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ads/ |
| Disallow | /adserver/ |
| Disallow | /consulting/catalog/ |
| Disallow | /imgs/ |
| Disallow | /img/ |
| Disallow | /images/ |
| Disallow | /include/ |
| Disallow | /index.inc/ |
| Disallow | /shop/software/ |
| Disallow | /parser/ |
| Disallow | /test/ |
| Disallow | /testzone/ |
| Disallow | /wwwstat/ |
| Disallow | /index.shtml |
| Disallow | /cgi-bin/ |
| Disallow | /shop/research/index.php |
| Disallow | /shop/businessplan/index.php |
| Disallow | /tender/index.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
yandex
| Rule | Path |
|---|---|
| Disallow | /ads/ |
| Disallow | /adserver/ |
| Disallow | /consulting/catalog/ |
| Disallow | /imgs/ |
| Disallow | /img/ |
| Disallow | /images/ |
| Disallow | /include/ |
| Disallow | /index.inc/ |
| Disallow | /shop/software/ |
| Disallow | /parser/ |
| Disallow | /test/ |
| Disallow | /testzone/ |
| Disallow | /wwwstat/ |
| Disallow | /index.shtml |
| Disallow | /cgi-bin/ |
| Disallow | /shop/research/index.php |
| Disallow | /shop/businessplan/index.php |
| Disallow | /tender/index.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cfin.ru/sitemap_.xml |
| sitemap | https://www.cfin.ru/sitemap_.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.