saddlemen.com
robots.txt
Robots Exclusion Standard data for saddlemen.com
Resource Scan
Scan Details
| Site Domain | saddlemen.com |
| Base Domain | saddlemen.com |
| Scan Status | Ok |
| Last Scan | 2024-09-26T18:36:26+00:00 |
| Next Scan | 2024-10-26T18:36:26+00:00 |
Last Scan
| Scanned | 2024-09-26T18:36:26+00:00 |
| URL | https://saddlemen.com/robots.txt |
| Redirect | https://www.saddlemen.com/robots.txt |
| Redirect Domain | www.saddlemen.com |
| Redirect Base | saddlemen.com |
| Domain IPs | 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52 |
| Redirect IPs | 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52 |
| Response IP | 199.232.47.52 |
| Found | Yes |
| Hash | 86dcf3b583a350cae6e773f2b16990209c72c1ced49e5dfb83bb7dd1ce26cb7d |
| SimHash | 4e0c9945adb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /download |
| Disallow | /export |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*?page= |
| Disallow | /*%26page%3D |
| Disallow | /wishlist |
| Disallow | /login |
| Disallow | /index.php?route=product%2Fmanufacturer |
| Disallow | /index.php?route=product%2Fcompare |
| Disallow | /index.php?route=product%2Fcategory |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
yandex
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /download |
| Disallow | /export |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*route%3Dproduct/search |
| Disallow | /*?page= |
| Disallow | /*%26page%3D |
| Disallow | /wishlist |
| Disallow | /login |
| Disallow | /index.php?route=product%2Fmanufacturer |
| Disallow | /index.php?route=product%2Fcompare |
| Disallow | /index.php?route=product%2Fcategory |
Other Records
| Field | Value |
|---|---|
| sitemap | https://saddlemen.com/sitemap.xml |
Warnings
- `host` is not a known field.