aistclub.ru
robots.txt
Robots Exclusion Standard data for aistclub.ru
Resource Scan
Scan Details
| Site Domain | aistclub.ru |
| Base Domain | aistclub.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-04-06T02:48:01+00:00 |
| Next Scan | 2024-07-05T02:48:01+00:00 |
Last Successful Scan
| Scanned | 2023-05-16T14:36:23+00:00 |
| URL | https://aistclub.ru/robots.txt |
| Redirect | https://www.aist-club.ru/robots.txt |
| Redirect Domain | www.aist-club.ru |
| Redirect Base | aist-club.ru |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:f1f6, 2a00:15f8:a000:5:1:12:0:f1f6, 2a00:15f8:a000:5:1:13:0:f1f6, 2a00:15f8:a000:5:1:14:0:f1f6, 90.156.201.105, 90.156.201.38, 90.156.201.44, 90.156.201.52 |
| Redirect IPs | 2a00:15f8:a000:5:1:11:0:f1f6, 2a00:15f8:a000:5:1:12:0:f1f6, 2a00:15f8:a000:5:1:13:0:f1f6, 2a00:15f8:a000:5:1:14:0:f1f6, 90.156.201.105, 90.156.201.38, 90.156.201.44, 90.156.201.52 |
| Response IP | 90.156.201.38 |
| Found | Yes |
| Hash | 219c8eeaa4b6ca328999ed46d8e3e85be733c37d6003f9e198099817202cf4c4 |
| SimHash | 4f65eb504790 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /*?_openstat= |
| Disallow | /*?gclid= |
| Disallow | /*?utm_source= |
| Disallow | /*from%3Dadwords |
| Disallow | /templates/ |
| Disallow | /plugins/ |
| Disallow | /links/ |
| Disallow | /*upload* |
| Disallow | /*index.php* |
| Disallow | /*c_podarok_* |
| Disallow | /404.php |
| Disallow | /*?mod* |
| Allow | /templates/*.JPG |
| Allow | /templates/*.jpg |
| Allow | /templates/*.png |
| Allow | /upload/*.png |
| Allow | /upload/*.jpg |
| Allow | /upload/*.JPG |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*?_openstat= |
| Disallow | /*?gclid= |
| Disallow | /*?utm_source= |
| Disallow | /*from%3Dadwords |
| Disallow | /links/ |
| Disallow | /*upload* |
| Disallow | /*index.php* |
| Disallow | /*c_podarok_* |
| Disallow | /404.php |
| Disallow | /*?mod* |
| Allow | /templates/*.JPG |
| Allow | /templates/*.jpg |
| Allow | /templates/*.png |
| Allow | /upload/*.png |
| Allow | /upload/*.jpg |
| Allow | /upload/*.JPG |
*
| Rule | Path |
|---|---|
| Disallow | /*?_openstat= |
| Disallow | /*?gclid= |
| Disallow | /*?utm_source= |
| Disallow | /*from%3Dadwords |
| Disallow | /templates/ |
| Disallow | /plugins/ |
| Disallow | /links/ |
| Disallow | /*upload* |
| Disallow | /*index.php* |
| Disallow | /*c_podarok_* |
| Disallow | /404.php |
| Disallow | /*?mod* |
| Allow | /templates/*.JPG |
| Allow | /templates/*.jpg |
| Allow | /templates/*.png |
| Allow | /upload/*.png |
| Allow | /upload/*.jpg |
| Allow | /upload/*.JPG |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.aistclub.ru/sitemap.xml |
Warnings
- `host` is not a known field.