arhles.net
robots.txt
Robots Exclusion Standard data for arhles.net
Resource Scan
Scan Details
| Site Domain | arhles.net |
| Base Domain | arhles.net |
| Scan Status | Ok |
| Last Scan | 2025-12-31T04:23:18+00:00 |
| Next Scan | 2026-01-30T04:23:18+00:00 |
Last Scan
| Scanned | 2025-12-31T04:23:18+00:00 |
| URL | https://arhles.net/robots.txt |
| Domain IPs | 87.236.16.247 |
| Response IP | 87.236.16.247 |
| Found | Yes |
| Hash | 6707857ddd5f467935b80f9cff7e9eb671f975cc5784183b56ee284a99d3d4ba |
| SimHash | 060cad46ad79 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /download |
| Disallow | /export |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*?search= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*?product_id=* |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*?page= |
| Disallow | /*?yprqee= |
| Disallow | /*%26yprqee%3D |
| Disallow | *?ybaip= |
| Disallow | /*%26page%3D |
| Disallow | /*?from= |
| Disallow | /*?clid=* |
| Disallow | /*?etext* |
| Disallow | /*?src_pof=* |
| Disallow | *?frommarket=* |
| Disallow | /wishlist |
| Disallow | /login |
| Disallow | /*?route=product%2Fproduct&product_id=* |
| Disallow | /index.php?route=product%2Fsearch&search= |
| Disallow | /index.php?route=product%2Fmanufacturer |
| Disallow | /index.php?route=product%2Fcompare |
| Disallow | /index.php?route=product%2Fcategory |
| Disallow | /*?route=product%2Fsearch&search=* |
*
| Rule | Path |
|---|---|
| Disallow | *?clid= |
| Disallow | *?ybaip= |
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id=* |
| Disallow | /admin |
| Disallow | /*?clid=* |
| Disallow | /*?src_pof=* |
| Disallow | /catalog |
| Disallow | /download |
| Disallow | /export |
| Disallow | /system |
| Disallow | /*?search= |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?product_id=* |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?yprqee= |
| Disallow | /*%26yprqee%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*?page= |
| Disallow | /*%26page%3D |
| Disallow | /wishlist |
| Disallow | /login |
| Disallow | /*?route=product%2Fproduct&product_id=* |
| Disallow | /*?route=product%2Fsearch&search=* |
| Disallow | *?frommarket=* |
| Disallow | /*?etext* |
| Disallow | /index.php?route=product%2Fmanufacturer |
| Disallow | /index.php?route=product%2Fcompare |
| Disallow | /index.php?route=product%2Fsearch&search=* |
| Disallow | /index.php?route=product%2Fcategory |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://arhles.net/sitemap.xml |
| sitemap | https://arhles.net/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.