shvedun.ru
robots.txt
Robots Exclusion Standard data for shvedun.ru
Resource Scan
Scan Details
| Site Domain | shvedun.ru |
| Base Domain | shvedun.ru |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-13T04:00:43+00:00 |
| Next Scan | 2024-09-27T04:00:43+00:00 |
Last Successful Scan
| Scanned | 2024-08-29T03:47:29+00:00 |
| URL | https://shvedun.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:1:f1, 2a00:15f8:a000:5:1:12:1:f1, 2a00:15f8:a000:5:1:13:1:f1, 2a00:15f8:a000:5:1:14:1:f1, 90.156.201.107, 90.156.201.20, 90.156.201.28, 90.156.201.71 |
| Response IP | 90.156.201.107 |
| Found | Yes |
| Hash | d57e36d068636db6ef8376c3034b31b6f54b579bbc067016e0be04d4bc306907 |
| SimHash | e561ee69edd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /phprusearch/ |
| Disallow | /dmonitor/ |
| Disallow | /images/astroobs/news/ |
Warnings
- `host` is not a known field.