topliba.com
robots.txt
Robots Exclusion Standard data for topliba.com
Resource Scan
Scan Details
| Site Domain | topliba.com |
| Base Domain | topliba.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T21:09:37+00:00 |
| Next Scan | 2024-10-02T21:09:37+00:00 |
Last Scan
| Scanned | 2024-09-25T21:09:37+00:00 |
| URL | https://topliba.com/robots.txt |
| Domain IPs | 195.201.81.20 |
| Response IP | 195.201.81.20 |
| Found | Yes |
| Hash | 6927d0302e0d4cc73bb36efe74a4da33eb09394490783fcbafd76a38c14a0aad |
| SimHash | 64189c446892 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /register |
| Disallow | /login |
| Disallow | /password/reset |
| Disallow | /users/online |
| Disallow | /users/*/library |
| Disallow | /users/*/authors |
| Disallow | /users/*/genres |
| Disallow | /books/*/download/zip |
| Disallow | /books/*/download/fb2 |
| Disallow | /files/ |
| Disallow | /reader/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://topliba.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.