citydog.by
robots.txt
Robots Exclusion Standard data for citydog.by
Resource Scan
Scan Details
| Site Domain | citydog.by |
| Base Domain | citydog.by |
| Scan Status | Ok |
| Last Scan | 2024-11-17T01:20:30+00:00 |
| Next Scan | 2024-11-24T01:20:30+00:00 |
Last Scan
| Scanned | 2024-11-17T01:20:30+00:00 |
| URL | https://citydog.by/robots.txt |
| Domain IPs | 79.133.126.103 |
| Response IP | 79.133.126.103 |
| Found | Yes |
| Hash | 7a94ec65d9a0b2d451ea1e11aca19fecfd58b6d97a855f8c1235f604eb0e3e7f |
| SimHash | 3834f68367b8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /comments/vote/* |
| Disallow | /comments/cancel/* |
| Disallow | /securimage/* |
| Disallow | /social/* |
| Disallow | /banner/redirect |
| Disallow | /admin/* |
| Disallow | /api/* |
| Disallow | /post/face/ |
| Disallow | /allposts/rubric/admetnyya/%26amp* |
| Disallow | /allposts/rubric/admetnyya/allposts* |
| Disallow | /*SITE_URL_EASYMINSK* |
| Disallow | /*comment-link-* |
| Disallow | /visitor* |
| Disallow | /*%5B%5B |
| Disallow | /*%5D%5D |
| Disallow | /*%5B%5B*%5D%5D* |
| Disallow | /var/www/citydog.io/www/* |
| Disallow | /var/www/citydog.by/www/* |
| Disallow | /*iframe* |
Warnings
- `host` is not a known field.