100bestbooks.ru
robots.txt
Robots Exclusion Standard data for 100bestbooks.ru
Resource Scan
Scan Details
| Site Domain | 100bestbooks.ru |
| Base Domain | 100bestbooks.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-13T03:01:10+00:00 |
| Next Scan | 2024-11-20T03:01:10+00:00 |
Last Scan
| Scanned | 2024-11-13T03:01:10+00:00 |
| URL | https://100bestbooks.ru/robots.txt |
| Redirect | https://www.100bestbooks.ru/robots.txt |
| Redirect Domain | www.100bestbooks.ru |
| Redirect Base | 100bestbooks.ru |
| Domain IPs | 2a00:15f8:a000:5:1:11:3:cd0, 2a00:15f8:a000:5:1:12:3:cd0, 2a00:15f8:a000:5:1:13:3:cd0, 2a00:15f8:a000:5:1:14:3:cd0, 90.156.201.13, 90.156.201.39, 90.156.201.51, 90.156.201.54 |
| Redirect IPs | 2a00:15f8:a000:5:1:11:3:cd0, 2a00:15f8:a000:5:1:12:3:cd0, 2a00:15f8:a000:5:1:13:3:cd0, 2a00:15f8:a000:5:1:14:3:cd0, 90.156.201.13, 90.156.201.39, 90.156.201.51, 90.156.201.54 |
| Response IP | 90.156.201.13 |
| Found | Yes |
| Hash | 3453b1a5777a8f5f20b0034f591abd13501796625a551d24811b98fc394b0634 |
| SimHash | aecac0c3d1b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /classes/ |
| Disallow | /include/ |
| Disallow | /kcaptcha/ |
| Disallow | /specific/ |
| Disallow | /vote.php |
| Disallow | /search_results.php |
| Disallow | /search.php |
| Disallow | /add_comment.php |
| Disallow | /read_ru_template.php |
Warnings
- `clean-param` is not a known field.