factomart.com
robots.txt
Robots Exclusion Standard data for factomart.com
Resource Scan
Scan Details
Site Domain | factomart.com |
Base Domain | factomart.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-13T19:49:30+00:00 |
Next Scan | 2024-12-12T19:49:30+00:00 |
Last Successful Scan
Scanned | 2022-11-22T14:58:08+00:00 |
URL | https://factomart.com/robots.txt |
Response IP | 104.26.0.21, 172.67.68.231, 104.26.1.21 |
Found | Yes |
Hash | 305e231c00bb944dd0d812be5d178ad73fabaf455a2fa2222ef6213f47ca7c6c |
SimHash | 68fb3cf24f02 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?ajax=1* |
Disallow | /*%26ajax%3D1* |
Disallow | /errors/* |
Disallow | /id/* |
Disallow | /errors/* |
Disallow | /index.php* |
Disallow | */catalogsearch/advanced/result/* |
Disallow | /review/* |
Disallow | /index.php/* |
Disallow | /email-marketing/* |
Disallow | /*/index/cat/*/ |
Disallow | /*limit%3D* |
Disallow | /*dir%3Dasc* |
Disallow | /*dir%3Ddesc* |
Disallow | /*mode%3Dlist* |
Disallow | /*___store* |
Disallow | /*mode%3Dgrid* |
Disallow | */brand/index/* |
Disallow | /media/catalog/product/datasheet/* |
Disallow | /*.html?* |
Disallow | */custom_category_footer/* |
Disallow | */brand-balluff/* |
Disallow | */tags.html/* |
Disallow | */customerattachments/view/history/* |
Disallow | */catalogsearch/result/* |
Disallow | */checkout/cart/add/* |
Disallow | */wishlist/index/add/* |
Disallow | */catalog/category/view/* |
Disallow | */catalog/product_compare/add/* |
Disallow | *gclid%3D* |
Disallow | /th/home |
Disallow | /en/home |
Disallow | /home |
Disallow | */catalog/product/view/* |
Disallow | /customer/account/ |
Disallow | /customer/address/ |
Disallow | /sales/order/history/ |
Disallow | /th/customer/account/ |
Disallow | /th/wishlist/ |
Disallow | /wishlist/ |
Disallow | /th/ajaxcart/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |