1library.org
robots.txt
Robots Exclusion Standard data for 1library.org
Resource Scan
Scan Details
| Site Domain | 1library.org |
| Base Domain | 1library.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-03-13T15:45:08+00:00 |
| Next Scan | 2025-06-11T15:45:08+00:00 |
Last Successful Scan
| Scanned | 2024-08-16T15:43:05+00:00 |
| URL | https://1library.org/robots.txt |
| Domain IPs | 104.21.66.217, 172.67.164.175, 2606:4700:3032::6815:42d9, 2606:4700:3035::ac43:a4af |
| Response IP | 104.21.66.217 |
| Found | Yes |
| Hash | 4a4a5dd812d92fcbc888934d7710274b1dc473269c6847b4eb686053d4da9ab0 |
| SimHash | 581e46f0c69a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /user/ |
| Disallow | /app/ |
| Disallow | /livewire/ |
| Disallow | /api/ |
| Disallow | /auth/ |
| Disallow | /sapi/ |
| Disallow | /iframe/ |
| Disallow | /arrilot/ |
| Disallow | /search |
| Disallow | /v4/ |
| Disallow | /v3/ |
| Disallow | /v2/ |
| Disallow | /document/download |
| Disallow | /blog |
| Disallow | /pub |
| Disallow | /tagged |
| Disallow | /upload |
| Disallow | /*/download/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://1library.org/sitemaps/document |
| sitemap | https://1library.org/sitemaps/user-document |
| sitemap | https://1library.org/sitemaps/titles |
| sitemap | https://1library.org/sitemaps/subjects |
| sitemap | https://1library.org/sitemaps/parts |
| sitemap | https://1library.org/sitemap/recent-documents.xml |
| sitemap | https://1library.org/sitemap/recent-articles.xml |