peon.ru
robots.txt
Robots Exclusion Standard data for peon.ru
Resource Scan
Scan Details
Site Domain | peon.ru |
Base Domain | peon.ru |
Scan Status | Ok |
Last Scan | 2024-05-29T01:34:13+00:00 |
Next Scan | 2024-06-28T01:34:13+00:00 |
Last Scan
Scanned | 2024-05-29T01:34:13+00:00 |
URL | http://peon.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:4:e6a1, 2a00:15f8:a000:5:1:12:4:e6a1, 2a00:15f8:a000:5:1:13:4:e6a1, 2a00:15f8:a000:5:1:14:4:e6a1, 90.156.201.116, 90.156.201.41, 90.156.201.59, 90.156.201.82 |
Response IP | 90.156.201.116 |
Found | Yes |
Hash | d8089aaf7a79fabb28d54d27337ef36bfa618e41bc3e01426144761f0141a5da |
SimHash | 0452e402a772 |
Groups
*
Rule | Path |
---|---|
Disallow | /_ST_SITE |
Disallow | /*.swf |
Disallow | /?search=* |
Disallow | /index.php?page=207 |
Disallow | /index.php?page=208 |
Disallow | /index.php?page=215 |
Disallow | /index.php?page=342 |
Disallow | /oformlenie_saita_v_novogodnem_stile.php |
Disallow | /obrabotka2.php |
Disallow | /combin.php |
Warnings
- `host` is not a known field.