gem-academia.ru
robots.txt
Robots Exclusion Standard data for gem-academia.ru
Resource Scan
Scan Details
Site Domain | gem-academia.ru |
Base Domain | gem-academia.ru |
Scan Status | Ok |
Last Scan | 2024-10-04T00:25:28+00:00 |
Next Scan | 2024-11-03T00:25:28+00:00 |
Last Scan
Scanned | 2024-10-04T00:25:28+00:00 |
URL | http://gem-academia.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:6:f688, 2a00:15f8:a000:5:1:12:6:f688, 2a00:15f8:a000:5:1:13:6:f688, 2a00:15f8:a000:5:1:14:6:f688, 90.156.201.109, 90.156.201.32, 90.156.201.39, 90.156.201.99 |
Response IP | 90.156.201.109 |
Found | Yes |
Hash | 65c4802f592fa08c533e30836244d69f68b5c2d287249b49f6207b18d2bf355b |
SimHash | 84400a0faf87 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.htm |
Disallow | /search.htm |
Disallow | /picture-click |
Disallow | /admin |
Disallow | *post_new |
Disallow | *topic_new |
Disallow | /*?refer |
Disallow | *asc |
Disallow | *desc |
Disallow | |
Disallow | /*utm_source* |
Disallow | /*openstat* |
Warnings
- `host` is not a known field.