nebogach.ru
robots.txt
Robots Exclusion Standard data for nebogach.ru
Resource Scan
Scan Details
| Site Domain | nebogach.ru |
| Base Domain | nebogach.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-25T21:55:40+00:00 |
| Next Scan | 2024-11-23T21:55:40+00:00 |
Last Successful Scan
| Scanned | 2023-05-04T21:35:14+00:00 |
| URL | https://nebogach.ru/robots.txt |
| Domain IPs | 91.236.136.168 |
| Response IP | 91.236.136.168 |
| Found | Yes |
| Hash | 4926d724c82e77cd156b1c9966fb5199f8394677d29e2ec6a8b989bca948b53e |
| SimHash | 61444f7253b6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /tag |
| Disallow | /archive |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /*article.html$ |
| Disallow | /agreement |
| Disallow | /privacy |
| Disallow | /contacts |
| Disallow | */g/ |
| Disallow | *?path=* |
| Disallow | *?url=* |
Warnings
- `host` is not a known field.