mangalib.org
robots.txt
Robots Exclusion Standard data for mangalib.org
Resource Scan
Scan Details
| Site Domain | mangalib.org |
| Base Domain | mangalib.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-09T23:28:32+00:00 |
| Next Scan | 2024-12-08T23:28:32+00:00 |
Last Successful Scan
| Scanned | 2024-02-13T16:45:10+00:00 |
| URL | https://mangalib.org/robots.txt |
| Domain IPs | 190.115.31.203 |
| Response IP | 190.115.31.203 |
| Found | Yes |
| Hash | 48d2eccaa498bf196e6aa594c9908ecdaa97ea51b6a2f69a089b4bacd00bd439 |
| SimHash | 2e93cc118b36 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /manga-rss |
| Disallow | /admin |
| Disallow | /install |
| Disallow | /user |
| Disallow | /download |
| Disallow | /chats |
| Disallow | /advanced-search |
| Disallow | /manga-list/scanlator |
| Disallow | /manga-list/author |
| Disallow | /manga-list/artist |
| Disallow | /manga-list/search |
| Disallow | /captcha |
| Disallow | /random |
| Disallow | /notifications |
| Allow | /*/v*/c*/1 |
| Disallow | /*/v*/c*/* |
| Disallow | /*/v*/c*/10* |
| Disallow | /*?comm_id=* |
*
| Rule | Path |
|---|---|
| Disallow | /manga-rss |
| Disallow | /admin |
| Disallow | /install |
| Disallow | /user |
| Disallow | /download |
| Disallow | /chats |
| Disallow | /uploads/manga |
| Disallow | /advanced-search |
| Disallow | /manga-list/scanlator |
| Disallow | /people/author |
| Disallow | /people/artist |
| Disallow | /people |
| Disallow | /manga-list |
| Disallow | /search |
| Disallow | /publisher |
| Disallow | /captcha |
| Disallow | /team |
| Disallow | /notifications |
| Disallow | /random |
| Disallow | /manga-rss |
| Disallow | /*?section=* |
| Disallow | /*?comm_id=* |
| Disallow | /*/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.