wayfair.co.uk
robots.txt
Robots Exclusion Standard data for wayfair.co.uk
Resource Scan
Scan Details
| Site Domain | wayfair.co.uk |
| Base Domain | wayfair.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-11T13:09:18+00:00 |
| Next Scan | 2024-11-18T13:09:18+00:00 |
Last Scan
| Scanned | 2024-11-11T13:09:18+00:00 |
| URL | https://wayfair.co.uk/robots.txt |
| Redirect | https://www.wayfair.co.uk/robots.txt |
| Redirect Domain | www.wayfair.co.uk |
| Redirect Base | wayfair.co.uk |
| Domain IPs | 151.101.1.252, 151.101.129.252, 151.101.193.252, 151.101.65.252 |
| Redirect IPs | 104.18.41.99, 172.64.146.157 |
| Response IP | 104.18.41.99 |
| Found | Yes |
| Hash | 78fca7312c0cbdad224cc5313ff853e6336d5cc822ab555502663b5cd5e40438 |
| SimHash | d1400b6517fd |
Groups
*
| Rule | Path |
|---|---|
| Allow | /v/business_account/trade_program/home |
| Disallow | /ajax/ |
| Disallow | /filter/ |
| Disallow | /filters/ |
| Disallow | */filters/ |
| Disallow | /hl_landing.php |
| Disallow | /imgview/ |
| Disallow | /logodownload.php |
| Disallow | /popups/ |
| Disallow | /shop/ |
| Disallow | /v/account/ |
| Disallow | /vmlt.php |
| Disallow | /a/ |
| Disallow | /a/product/get_product_content |
| Disallow | /a/category/category_page/lazy_load_category_tree |
| Allow | /shop-the-look/$ |
| Allow | /shop-the-look/slp/ |
| Allow | /shop-the-look/dsp/ |
| Allow | /shop-the-look/sl0 |
| Allow | /shop-the-look/sl1/ |
| Allow | /shop-the-look/sl2/ |
| Disallow | /shop-the-look/ |
| Disallow | /v/get_the_look/ |
| Disallow | /v/product_review_page/ |
| Disallow | /product_review_page/ |
| Disallow | /session/secure/ |
| Disallow | /asp/ |
| Disallow | /ib/ |
| Disallow | /param.xml |
| Disallow | /return_sales_items.php |
| Disallow | /session/public/board |
| Disallow | /Staples/ |
| Disallow | /v/category/show |
| Disallow | /a/favorites/list/is_favorited |
| Disallow | /a/performance_timing/log |
| Disallow | /b/batch |
| Disallow | /gateway.php |
| Disallow | /pixel/%21crd_prm%21.gif |
| Disallow | /set_location.php |
| Disallow | /v/category/get_top_level_categories |
| Disallow | /v/inventory/load |
| Disallow | /v/product_image_group/get_images |
| Disallow | /session/public/submit_review.php |
| Disallow | /session/public/basket.php |
| Disallow | /v/checkout/ |
| Disallow | /registry/browse/ |
| Disallow | /registry/checklist/ |
| Disallow | /v/ideaboards/ |
| Disallow | /compare.php |
| Disallow | /visual_search/ |
| Disallow | /finds |
| Disallow | /flashdeals |
| Disallow | /roomplanner/ |
| Disallow | /service_worker.js |
| Allow | /session/secure/account/rewards_signup.php |
| Disallow | /Shop-The-Look/filters/ |
| Disallow | /blog/wp-content/ |
| Disallow | /v/inspiration_gallery/photo_products |
| Disallow | /daily-sales/master |
| Disallow | /registry/wedding/ |
| Disallow | /roomplanner3d/ |
| Disallow | /*?*curpage=* |