yarn.com
robots.txt
Robots Exclusion Standard data for yarn.com
Resource Scan
Scan Details
| Site Domain | yarn.com |
| Base Domain | yarn.com |
| Scan Status | Ok |
| Last Scan | 2024-05-26T02:47:29+00:00 |
| Next Scan | 2024-06-02T02:47:29+00:00 |
Last Scan
| Scanned | 2024-05-26T02:47:29+00:00 |
| URL | https://yarn.com/robots.txt |
| Redirect | https://www.yarn.com/robots.txt |
| Redirect Domain | www.yarn.com |
| Redirect Base | yarn.com |
| Domain IPs | 108.156.133.12, 108.156.133.30, 108.156.133.39, 108.156.133.69 |
| Redirect IPs | 108.156.133.12, 108.156.133.30, 108.156.133.39, 108.156.133.69 |
| Response IP | 108.156.133.30 |
| Found | Yes |
| Hash | ca5350739b0288f0cef442173da7677f0b7b5b2ba165c947013cb759b6a22811 |
| SimHash | f21494722ea1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | */*?p= |
| Disallow | */index.php/ |
| Disallow | */catalog/compare |
| Disallow | */catalog/product_compare/ |
| Disallow | */catalog/category/view/ |
| Disallow | */catalog/product/view/ |
| Disallow | */catalogsearch/ |
| Disallow | */search/ |
| Disallow | */search?q= |
| Disallow | */checkout/ |
| Disallow | */j2tajaxcheckout/ |
| Disallow | */minibasket/ |
| Disallow | */cart/ |
| Disallow | */order/ |
| Disallow | */cart-sync |
| Disallow | */contacts/ |
| Disallow | */lazyblocks/ |
| Disallow | */multiwarehouse/stock/ |
| Disallow | */kitbuilder/ |
| Disallow | */shopby/ |
| Disallow | */esi/ |
| Disallow | */express-payments/ |
| Disallow | */mention-me/ |
| Disallow | */subscribe/ |
| Disallow | */trendingBanner?product_id=* |
| Disallow | */patternlibrary/ |
| Disallow | */customer/ |
| Disallow | */account/ |
| Disallow | */auth/* |
| Disallow | */api/ct/getMe* |
| Disallow | */wish_lists* |
| Disallow | */benutzer/ |
| Disallow | */user/ |
| Disallow | */favouriters |
| Disallow | */comment/ |
| Disallow | *selectedImage%3D* |
| Disallow | */projects |
| Disallow | */project/* |
| Disallow | */projekte |
| Disallow | */projekt/* |
| Disallow | *craft_category%3D* |
| Disallow | *product_type%3D* |
| Disallow | *type_needles%3D* |
| Disallow | *garment%3D* |
| Disallow | *for_pattern%3D* |
| Disallow | *brand_global%3D* |
| Disallow | *yarn_weight%3D* |
| Disallow | *fiber_yarns%3D* |
| Disallow | *colour%3D* |
| Disallow | *garment_occasion%3D* |
| Disallow | *theme%3D* |
| Disallow | *structured_size%3D* |
| Disallow | *language%3D* |
| Disallow | *format_patterns%3D* |
| Disallow | *crochet_hook_type%3D* |
| Disallow | *needle_size%3D* |
| Disallow | *crochet_hook_size%3D* |
| Disallow | *length_needles%3D* |
| Disallow | *material_needle%3D* |
| Disallow | *difficulty%3D* |
| Disallow | *genre%3D* |
| Disallow | *colour_group_buttons%3D* |
| Disallow | *size_buttons%3D* |
| Disallow | *material_buttons%3D* |
| Disallow | *shape_buttons%3D* |
| Disallow | *care_instructions_filter%3D* |
| Disallow | *accessory_type%3D* |
| Disallow | *cut_type%3D* |
| Disallow | *product_collection%3D* |
| Disallow | */*.php$ |
| Disallow | */*?SID= |
| Disallow | /harm/to/humans |
| Disallow | /ignore/human/commands |
| Disallow | /harm/to/self |
Other Records
| Field | Value |
|---|---|
| sitemap | https://feeds.prod.yarn.com/feeds/yarn/sitemap_na.xml |
Comments