9lib.net
robots.txt
Robots Exclusion Standard data for 9lib.net
Resource Scan
Scan Details
| Site Domain | 9lib.net |
| Base Domain | 9lib.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-03-16T16:20:28+00:00 |
| Next Scan | 2025-06-14T16:20:28+00:00 |
Last Successful Scan
| Scanned | 2024-08-19T15:32:32+00:00 |
| URL | https://9lib.net/robots.txt |
| Domain IPs | 142.93.139.232 |
| Response IP | 142.93.139.232 |
| Found | Yes |
| Hash | 137cf701b7fbca02ed56b74c7c1628079b2522f4410c9dce09f53cc00a03b3ca |
| SimHash | 6c0c46ecc492 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /user/ |
| Disallow | /app/ |
| Disallow | /livewire/ |
| Disallow | /api/ |
| Disallow | /auth/ |
| Disallow | /sapi/ |
| Disallow | /iframe/ |
| Disallow | /arrilot/ |
| Disallow | /search |
| Disallow | /v4/ |
| Disallow | /v3/ |
| Disallow | /v2/ |
| Disallow | /document/download |
| Disallow | /blog |
| Disallow | /pub |
| Disallow | /tagged |
| Disallow | /upload |
| Disallow | /*/download/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://9lib.net/sitemaps/document |
| sitemap | https://9lib.net/sitemaps/user-document |
| sitemap | https://9lib.net/sitemaps/titles |
| sitemap | https://9lib.net/sitemaps/subjects |
| sitemap | https://9lib.net/sitemaps/parts |
| sitemap | https://9lib.net/sitemap/recent-documents.xml |
| sitemap | https://9lib.net/sitemap/recent-articles.xml |