klaw.ru
robots.txt
Robots Exclusion Standard data for klaw.ru
Resource Scan
Scan Details
| Site Domain | klaw.ru |
| Base Domain | klaw.ru |
| Scan Status | Ok |
| Last Scan | 2026-02-02T16:22:07+00:00 |
| Next Scan | 2026-02-09T16:22:07+00:00 |
Last Scan
| Scanned | 2026-02-02T16:22:07+00:00 |
| URL | https://klaw.ru/robots.txt |
| Domain IPs | 193.106.172.49 |
| Response IP | 193.106.172.49 |
| Found | Yes |
| Hash | 1aa1f3cac813bc99117debdd8d65f1460a1f47ece206ad2d06e7652652792698 |
| SimHash | ed01e841cdd2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /generator/ |
| Disallow | /adadmin/ |
| Disallow | /forms/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://klaw.ru/sitemap.xml |
| sitemap | https://klaw.ru/sitemap2.xml |
| sitemap | https://klaw.ru/sitemap2.xml.gz |
| sitemap | https://klaw.ru/sitemap_images.xml |
| sitemap | https://klaw.ru/sitemap_images.xml.gz |
Warnings
- `host` is not a known field.