t-library.net
robots.txt
Robots Exclusion Standard data for t-library.net
Resource Scan
Scan Details
| Site Domain | t-library.net |
| Base Domain | t-library.net |
| Scan Status | Ok |
| Last Scan | 2025-10-31T16:16:03+00:00 |
| Next Scan | 2025-11-30T16:16:03+00:00 |
Last Scan
| Scanned | 2025-10-31T16:16:03+00:00 |
| URL | https://t-library.net/robots.txt |
| Domain IPs | 104.21.58.191, 172.67.206.190, 2606:4700:3032::ac43:cebe, 2606:4700:3033::6815:3abf |
| Response IP | 172.67.206.190 |
| Found | Yes |
| Hash | 5201eda52522f589644a42d5f065d50184850c327196b268d3f8a79121ed4c89 |
| SimHash | 83488442c8b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /linksAdd.php |
| Disallow | /lastLinks.php |
| Disallow | /cabinet.php |
| Disallow | /search.php |
| Disallow | /getTiff.php |
| Disallow | /getFiles.php |
| Disallow | /showBook.php? |
| Disallow | /read.php? |
| Disallow | /showAuthor.php? |
| Disallow | /showCategory.php? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 300 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://t-library.net/sitemap.php |
Warnings
- `host` is not a known field.
Comments