web-skazki.ru
robots.txt
Robots Exclusion Standard data for web-skazki.ru
Resource Scan
Scan Details
| Site Domain | web-skazki.ru |
| Base Domain | web-skazki.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-16T12:33:26+00:00 |
| Next Scan | 2024-11-23T12:33:26+00:00 |
Last Scan
| Scanned | 2024-11-16T12:33:26+00:00 |
| URL | https://web-skazki.ru/robots.txt |
| Domain IPs | 93.127.216.34 |
| Response IP | 93.127.216.34 |
| Found | Yes |
| Hash | 47f8506c6cba68da03f5f6acb732507e46c861c29fdd039800f67e01a5f77779 |
| SimHash | 29089863c331 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /download/ |
| Disallow | /*?*cache=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://web-skazki.ru/sitemap.xml |
Warnings
- `host` is not a known field.