itakstr.ru
robots.txt
Robots Exclusion Standard data for itakstr.ru
Resource Scan
Scan Details
| Site Domain | itakstr.ru |
| Base Domain | itakstr.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-03T17:01:30+00:00 |
| Next Scan | 2024-10-10T17:01:30+00:00 |
Last Scan
| Scanned | 2024-10-03T17:01:30+00:00 |
| URL | https://itakstr.ru/robots.txt |
| Domain IPs | 104.21.11.171, 172.67.166.176, 2606:4700:3031::ac43:a6b0, 2606:4700:3037::6815:bab |
| Response IP | 172.67.166.176 |
| Found | Yes |
| Hash | d2b2b9fd0de9cdbcc4d15026f108306ad34ce1d21a971b7b0442d5289f25e22e |
| SimHash | 420cd852c5f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /author/ |
| Disallow | /manager/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://itakstr.ru/sitemap.xml |
| sitemap | https://itakstr.ru/sitemap.xml |
Warnings
- `host` is not a known field.