agro-directory.dp.ua
robots.txt
Robots Exclusion Standard data for agro-directory.dp.ua
Resource Scan
Scan Details
| Site Domain | agro-directory.dp.ua |
| Base Domain | agro-directory.dp.ua |
| Scan Status | Ok |
| Last Scan | 2024-11-13T05:47:46+00:00 |
| Next Scan | 2024-11-20T05:47:46+00:00 |
Last Scan
| Scanned | 2024-11-13T05:47:46+00:00 |
| URL | https://agro-directory.dp.ua/robots.txt |
| Domain IPs | 104.21.86.125, 172.67.219.211, 2606:4700:3032::6815:567d, 2606:4700:3033::ac43:dbd3 |
| Response IP | 172.67.219.211 |
| Found | Yes |
| Hash | 32942cd0c9fe4b19484f6dec8371316897da8ef2b348dafdf79450520f3457ed |
| SimHash | 68a45e6b63a0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cp/ |
| Disallow | /banner/ |
| Disallow | /banner2/ |
| Disallow | /gallery/ |
| Disallow | /fonts/ |
| Disallow | /lang/ |
| Disallow | /logo/ |
| Disallow | /offer/ |
| Disallow | /upload/ |
| Disallow | /template/ |
| Disallow | /conf/ |
| Disallow | /out |
| Allow | /template/default/*.gif* |
| Allow | /template/default/*.css* |
| Allow | /banner2/*.gif* |
| Allow | /template/default/*.jpg* |
| Allow | /banner2/*.jpg* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://agro-directory.dp.ua/sitemap.xml |
Warnings
- `host` is not a known field.