ilibrary.ru
robots.txt
Robots Exclusion Standard data for ilibrary.ru
Resource Scan
Scan Details
| Site Domain | ilibrary.ru |
| Base Domain | ilibrary.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-16T06:35:46+00:00 |
| Next Scan | 2024-11-23T06:35:46+00:00 |
Last Scan
| Scanned | 2024-11-16T06:35:46+00:00 |
| URL | https://ilibrary.ru/robots.txt |
| Domain IPs | 91.109.206.157 |
| Response IP | 91.109.206.157 |
| Found | Yes |
| Hash | ea26385dd2dcc45606aa96d43b23f7b3947c4bd338dd171f86873faf463b9571 |
| SimHash | 3b239ee0d651 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /cgi/ |
| Disallow | /images/ |
| Disallow | /i/ |
| Disallow | /scripts/ |
| Disallow | /sources/ |
| Disallow | /search.phtml |
| Disallow | /index.phtml |
| Disallow | /text/459/ |
| Disallow | /text/10/ |
| Disallow | /text/1566/ |
Warnings
- `clean-param` is not a known field.