dev.ua
robots.txt
Robots Exclusion Standard data for dev.ua
Resource Scan
Scan Details
| Site Domain | dev.ua |
| Base Domain | dev.ua |
| Scan Status | Ok |
| Last Scan | 2024-11-11T10:59:20+00:00 |
| Next Scan | 2024-11-18T10:59:20+00:00 |
Last Scan
| Scanned | 2024-11-11T10:59:20+00:00 |
| URL | https://dev.ua/robots.txt |
| Domain IPs | 104.21.58.58, 172.67.168.7, 2606:4700:3034::ac43:a807, 2606:4700:3035::6815:3a3a |
| Response IP | 104.21.58.58 |
| Found | Yes |
| Hash | b6f4e7e0e2a73b5a11a5c8473cdfe37ed8dff68ff4ddf36fd5d3bb298aeb5e15 |
| SimHash | 2d04b940cb90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /newrelic |
| Disallow | /*?sort= |
| Disallow | /vote* |
| Disallow | /*?tag=* |
| Disallow | /*?fbclid* |
| Disallow | /preview?preview_token |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dev.ua/sitemap.xml |
| sitemap | https://dev.ua/ru/sitemap.xml |
Warnings
- `host` is not a known field.