crazycrab.com.ua
robots.txt
Robots Exclusion Standard data for crazycrab.com.ua
Resource Scan
Scan Details
| Site Domain | crazycrab.com.ua |
| Base Domain | crazycrab.com.ua |
| Scan Status | Ok |
| Last Scan | 2026-01-29T11:04:48+00:00 |
| Next Scan | 2026-02-28T11:04:48+00:00 |
Last Scan
| Scanned | 2026-01-29T11:04:48+00:00 |
| URL | https://crazycrab.com.ua/robots.txt |
| Domain IPs | 185.68.16.124, 2a00:7a60:0:107c::1 |
| Response IP | 185.68.16.124 |
| Found | Yes |
| Hash | 1aaa9069e438da68dbefdc51abb33974a068103963e6abd87782dfa296f0ea92 |
| SimHash | c50d8d466d33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter= |
| Disallow | /*%26filter%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | *page%3D* |
| Disallow | *search%3D* |
| Disallow | /cart/ |
| Disallow | /forgot-password/ |
| Disallow | /login/ |
| Disallow | /compare-products/ |
| Disallow | /add-return/ |
| Disallow | /vouchers/ |
| Allow | /catalog/view/javascript/ |
| Allow | /catalog/view/theme* |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.png |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crazycrab.com.ua/sitemap.xml |
Warnings
- `host` is not a known field.