mir-knigi.net
robots.txt
Robots Exclusion Standard data for mir-knigi.net
Resource Scan
Scan Details
| Site Domain | mir-knigi.net |
| Base Domain | mir-knigi.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-10T08:26:24+00:00 |
| Next Scan | 2025-02-08T08:26:24+00:00 |
Last Successful Scan
| Scanned | 2023-10-18T07:20:47+00:00 |
| URL | https://mir-knigi.net/robots.txt |
| Domain IPs | 185.244.217.73 |
| Response IP | 185.244.217.73 |
| Found | Yes |
| Hash | 51fca0211c100a9dea6087bb3b12af653d0f095bae9584feedd3c4adecafdcf3 |
| SimHash | 710d30734071 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*do%3Ddownload |
| Disallow | /*do%3Dgo |
Other Records
| Field | Value |
|---|---|
| sitemap | https://mir-knigi.net/sitemap.xml |
| sitemap | https://mir-knigi.net/ro/sitemap.xml |
| sitemap | https://mir-knigi.net/en/sitemap.xml |
| sitemap | https://mir-knigi.net/es/sitemap.xml |
| sitemap | https://mir-knigi.net/pl/sitemap.xml |
| sitemap | https://mir-knigi.net/uk/sitemap.xml |
Warnings
- `host` is not a known field.