ark-servers.pro
robots.txt
Robots Exclusion Standard data for ark-servers.pro
Resource Scan
Scan Details
| Site Domain | ark-servers.pro |
| Base Domain | ark-servers.pro |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-02-15T19:45:59+00:00 |
| Next Scan | 2025-05-16T19:45:59+00:00 |
Last Successful Scan
| Scanned | 2024-10-25T12:03:26+00:00 |
| URL | https://ark-servers.pro/robots.txt |
| Domain IPs | 104.21.82.78, 172.67.155.55, 2606:4700:3033::ac43:9b37, 2606:4700:3036::6815:524e |
| Response IP | 104.21.82.78 |
| Found | Yes |
| Hash | 7b49de7b2804a9436ddfdd419bd06552ce615a35889e93f0759eaaf5811af77a |
| SimHash | 4380bb43ebf2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php$ |
| Disallow | /captcha |
| Disallow | /support |
| Disallow | /login |
| Disallow | /registration |
| Disallow | /lostpassword |
| Disallow | /closed |
| Disallow | /news |
| Disallow | /widget |
| Disallow | /widget/* |
| Disallow | /web/* |
| Disallow | /api/* |
| Disallow | /go/* |
| Disallow | /graph-* |
| Disallow | /abusec-* |
| Disallow | /abuses-* |
| Disallow | /store/* |
| Allow | /store$ |
| Allow | /store/project |
| Allow | /store/other |
yandex
| Rule | Path |
|---|---|
| Disallow | /index.php$ |
| Disallow | /captcha |
| Disallow | /support |
| Disallow | /login |
| Disallow | /registration |
| Disallow | /lostpassword |
| Disallow | /closed |
| Disallow | /news |
| Disallow | /widget |
| Disallow | /widget/* |
| Disallow | /web/* |
| Disallow | /api/* |
| Disallow | /go/* |
| Disallow | /graph-* |
| Disallow | /abusec-* |
| Disallow | /abuses-* |
| Disallow | /store/* |
| Allow | /store$ |
| Allow | /store/project |
| Allow | /store/other |
Other Records
| Field | Value |
|---|---|
| sitemap | http://ark-servers.pro/sitemap.xml |
| sitemap | http://ark-servers.pro/sitemap.xml |
Warnings
- `host` is not a known field.