cyberleninka.ru
robots.txt
Robots Exclusion Standard data for cyberleninka.ru
Resource Scan
Scan Details
| Site Domain | cyberleninka.ru |
| Base Domain | cyberleninka.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-04T20:13:03+00:00 |
| Next Scan | 2024-11-11T20:13:03+00:00 |
Last Scan
| Scanned | 2024-11-04T20:13:03+00:00 |
| URL | https://cyberleninka.ru/robots.txt |
| Domain IPs | 37.27.60.2 |
| Response IP | 37.27.60.2 |
| Found | Yes |
| Hash | bd5397b811cbd7a3a251437b6a3d0f7ed94c847f3592d089c14edd93a84a09b0 |
| SimHash | 4d740a52cfd2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/* |
| Disallow | /search? |
| Disallow | /user/* |
| Disallow | /donate/* |
| Disallow | /article/n/*/viewer |
| Disallow | /article/v/* |
| Disallow | /api/ |
| Disallow | /article/n/*/pdf |
| Disallow | /article/n/*.pdf |
| Disallow | /viewer_images/* |
Warnings
- `host` is not a known field.