fantasts.ru
robots.txt
Robots Exclusion Standard data for fantasts.ru
Resource Scan
Scan Details
| Site Domain | fantasts.ru |
| Base Domain | fantasts.ru |
| Scan Status | Ok |
| Last Scan | 2025-12-09T14:38:29+00:00 |
| Next Scan | 2026-01-08T14:38:29+00:00 |
Last Scan
| Scanned | 2025-12-09T14:38:29+00:00 |
| URL | https://fantasts.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:c68b, 2a00:15f8:a000:5:1:12:0:c68b, 2a00:15f8:a000:5:1:13:0:c68b, 2a00:15f8:a000:5:1:14:0:c68b, 90.156.201.101, 90.156.201.59, 90.156.201.64, 90.156.201.98 |
| Response IP | 90.156.201.98 |
| Found | Yes |
| Hash | 5a3769a4bb1cf53d70fdb691bff3e67118d7a184a32046034e2e49330e2b3266 |
| SimHash | 6b1cd8e0efd5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /auth* |
| Disallow | /redirect* |
| Disallow | /activity* |
| Disallow | /tags/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://fantasts.ru/sitemap.xml |
Warnings
- `host` is not a known field.