leonmin.ru
robots.txt
Robots Exclusion Standard data for leonmin.ru
Resource Scan
Scan Details
| Site Domain | leonmin.ru |
| Base Domain | leonmin.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-17T00:38:21+00:00 |
| Next Scan | 2024-11-15T00:38:21+00:00 |
Last Successful Scan
| Scanned | 2023-12-28T23:44:09+00:00 |
| URL | https://leonmin.ru/robots.txt |
| Domain IPs | 188.225.30.144 |
| Response IP | 188.225.30.144 |
| Found | Yes |
| Hash | b737ce7d6cb48e0e2baca085323e03e9ec1326194604330b8326745cfb7f02a8 |
| SimHash | c9d719d27694 |
Groups
google
| Rule | Path |
|---|---|
| Disallow | /1C/ |
| Disallow | /admin/* |
| Disallow | /assets/ |
| Disallow | /brand/ |
| Disallow | /components/ |
| Disallow | /design/ |
| Disallow | /cart/ |
| Disallow | /user/ |
| Disallow | /compare/ |
| Disallow | /desire/ |
| Disallow | /files/ |
| Disallow | /js/ |
| Disallow | /payment/ |
| Disallow | /product/ |
| Disallow | /system/ |
| Disallow | /*.php$ |
| Disallow | /*?del* |
| Disallow | /*Index.php* |
| Disallow | /*?$ |
| Disallow | /*price%5* |
| Disallow | /*clid* |
| Disallow | /*collectible-minerals* |
| Disallow | /*polished-stones* |
| Disallow | /*agates* |
| Disallow | /*fluorescent-minerals-uv* |
| Disallow | /*balls-spheres* |
| Disallow | /*meteorites* |
| Disallow | /*for-jewelers* |
| Disallow | /*wholesale* |
| Disallow | /404/ |
| Disallow | /*webmaster* |
| Disallow | /news/* |
| Disallow | /catalog/kollekcionnye-mineraly/tag* |
| Disallow | /images/uploads* |
| Disallow | /catalog/agatovye-miniatyury/ |
| Disallow | /catalog/agaty |
| Allow | /news/?page=* |
yandex
| Rule | Path |
|---|---|
| Disallow | /1C/ |
| Disallow | /admin/* |
| Disallow | /assets/ |
| Disallow | /brand/ |
| Disallow | /components/ |
| Disallow | /design/ |
| Disallow | /cart/ |
| Disallow | /user/ |
| Disallow | /compare/ |
| Disallow | /desire/ |
| Disallow | /files/ |
| Disallow | /js/ |
| Disallow | /payment/ |
| Disallow | /product/ |
| Disallow | /system/ |
| Disallow | /*.php$ |
| Disallow | /*?del* |
| Disallow | /*Index.php* |
| Disallow | /*?$ |
| Disallow | /*price%5* |
| Disallow | /*clid* |
| Disallow | /*collectible-minerals* |
| Disallow | /*polished-stones* |
| Disallow | /*agates* |
| Disallow | /*fluorescent-minerals-uv* |
| Disallow | /*balls-spheres* |
| Disallow | /*meteorites* |
| Disallow | /*for-jewelers* |
| Disallow | /*wholesale* |
| Disallow | /404/ |
| Disallow | /*webmaster* |
| Disallow | /news/* |
| Disallow | /catalog/kollekcionnye-mineraly/tag* |
| Disallow | /images/uploads* |
| Disallow | /catalog/agatovye-miniatyury/ |
| Disallow | /catalog/agaty |
| Allow | /news/?page=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.leonmin.ru/sitemap.xml |
Warnings
- 4 invalid lines.
- `clean-param` is not a known field.
- `host` is not a known field.