pex.com.ua
robots.txt
Robots Exclusion Standard data for pex.com.ua
Resource Scan
Scan Details
| Site Domain | pex.com.ua |
| Base Domain | pex.com.ua |
| Scan Status | Ok |
| Last Scan | 2024-11-12T19:57:30+00:00 |
| Next Scan | 2024-12-12T19:57:30+00:00 |
Last Scan
| Scanned | 2024-11-12T19:57:30+00:00 |
| URL | https://pex.com.ua/robots.txt |
| Domain IPs | 104.21.0.124, 172.67.150.244, 2606:4700:3031::6815:7c, 2606:4700:3033::ac43:96f4 |
| Response IP | 172.67.150.244 |
| Found | Yes |
| Hash | d0a8e548ff6bf30333537d65786107e153c12f3166c9c2bc12a155a72b05a3c7 |
| SimHash | 703c034b6eb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter= |
| Disallow | /*%26filter%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
yandex
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter= |
| Disallow | /*%26filter%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
Warnings
- 12 invalid lines.
- `clean-param` is not a known field.