studylib.ru
robots.txt
Robots Exclusion Standard data for studylib.ru
Resource Scan
Scan Details
| Site Domain | studylib.ru |
| Base Domain | studylib.ru |
| Scan Status | Ok |
| Last Scan | 2025-06-16T18:31:54+00:00 |
| Next Scan | 2025-07-16T18:31:54+00:00 |
Last Scan
| Scanned | 2025-06-16T18:31:54+00:00 |
| URL | https://studylib.ru/robots.txt |
| Redirect | https://pubdoc.ru/robots.txt |
| Redirect Domain | pubdoc.ru |
| Redirect Base | pubdoc.ru |
| Domain IPs | 104.21.79.27, 172.67.140.235, 2606:4700:3030::ac43:8ceb, 2606:4700:3032::6815:4f1b |
| Redirect IPs | 104.21.16.74, 172.67.166.231, 2606:4700:3037::6815:104a, 2606:4700:3037::ac43:a6e7 |
| Response IP | 104.21.16.74 |
| Found | Yes |
| Hash | 6d1ea57f675923a399eb7c9a8f7e2ec2b54de3bba8f1addc25821c7003fff477 |
| SimHash | 001a9e9085b8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /viewer_next/ |
| Disallow | /theme/ |
| Allow | /theme/*/static |
| Disallow | /store/ |
| Disallow | /upload |
| Disallow | /download/ |
| Disallow | /docinfo.xml |
| Disallow | /sendmail.html |
| Disallow | /ask/searchAjax |
| Disallow | /cdn-cgi/ |
| Disallow | /search/ |
| Disallow | /documents/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pubdoc.ru/sitemap.xml |
Warnings
- `host` is not a known field.