hentailib.me
robots.txt
Robots Exclusion Standard data for hentailib.me
Resource Scan
Scan Details
| Site Domain | hentailib.me |
| Base Domain | hentailib.me |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-11T02:20:30+00:00 |
| Next Scan | 2024-11-25T02:20:30+00:00 |
Last Successful Scan
| Scanned | 2024-10-26T18:42:39+00:00 |
| URL | https://hentailib.me/robots.txt |
| Domain IPs | 186.2.163.220 |
| Response IP | 186.2.163.220 |
| Found | Yes |
| Hash | dafe230cca11e4e75ef4dd2052ad3b3f14caf1618b6372eea4747ed1524a54f5 |
| SimHash | cf1738f0c3b1 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /ru/book/*/edit |
| Disallow | /ru/manga/*/edit |
| Disallow | /ru/book/* |
| Disallow | /notifications |
| Disallow | /ru/random |
| Disallow | /ru/user/* |
| Disallow | /ru/anime/*/add-player |
*
| Rule | Path |
|---|---|
| Disallow | /manga/*/edit |
| Disallow | /book/*/edit |
| Disallow | /forum/ |
| Disallow | /notifications |
| Disallow | /random |
| Disallow | /ru/anime/*/watch |
| Disallow | /ru/book/* |
| Disallow | /ru/people/*/form |
| Disallow | /ru/team/*/edit |
| Disallow | /ru/characters/*/form |
| Disallow | /ru/*/read/v*/c* |
| Disallow | /ru/manga/*/chapter |
| Disallow | /ru/manga/*/edit |
| Disallow | /ru/manga/*/episodes |
| Disallow | /ru/manga/*/add-player |
| Disallow | /ru/anime/*/add-player |
| Disallow | /ru/user/* |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.