mining-portal.ru
robots.txt
Robots Exclusion Standard data for mining-portal.ru
Resource Scan
Scan Details
| Site Domain | mining-portal.ru |
| Base Domain | mining-portal.ru |
| Scan Status | Ok |
| Last Scan | 2025-09-10T16:33:23+00:00 |
| Next Scan | 2025-10-10T16:33:23+00:00 |
Last Scan
| Scanned | 2025-09-10T16:33:23+00:00 |
| URL | https://mining-portal.ru/robots.txt |
| Domain IPs | 45.130.41.90 |
| Response IP | 45.130.41.90 |
| Found | Yes |
| Hash | b2206b2182edc8ff41d2d7134f6afc11c2ebc1e75a25464a5f01c1022a5dd316 |
| SimHash | 6d182ac5c293 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cgi-bin/ |
| Disallow | /cron/ |
| Disallow | /_parse/ |
| Disallow | /min/ |
| Disallow | /*search |
| Disallow | /?download |
| Disallow | /*?compare |
| Disallow | /memberlist |
| Disallow | /viewonline |
| Disallow | /posting |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.mining-portal.ru/sitemap.xml/ |
Warnings
- `host` is not a known field.