wayfair.com
robots.txt
Robots Exclusion Standard data for wayfair.com
Resource Scan
Scan Details
| Site Domain | wayfair.com |
| Base Domain | wayfair.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T12:07:21+00:00 |
| Next Scan | 2024-11-23T12:07:21+00:00 |
Last Scan
| Scanned | 2024-11-16T12:07:21+00:00 |
| URL | https://wayfair.com/robots.txt |
| Redirect | https://www.wayfair.com/robots.txt |
| Redirect Domain | www.wayfair.com |
| Redirect Base | wayfair.com |
| Domain IPs | 151.101.1.252, 151.101.129.252, 151.101.193.252, 151.101.65.252 |
| Redirect IPs | 104.18.42.218, 172.64.145.38 |
| Response IP | 104.18.42.218 |
| Found | Yes |
| Hash | 88db0b7466262f3ef03661730b2a75ecff2b4919d75bd0a51ca3de8277651a63 |
| SimHash | b08210c045f7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /v/business_account/trade_program/home |
| Disallow | /ajax/ |
| Disallow | /filter/ |
| Disallow | /filters/ |
| Disallow | */filters/ |
| Disallow | /hl_landing.php |
| Disallow | /imgview/ |
| Disallow | /logodownload.php |
| Disallow | /popups/ |
| Disallow | /shop/ |
| Disallow | /v/account/ |
| Disallow | /vmlt.php |
| Allow | /shop-the-look/$ |
| Allow | /shop-the-look/slp/ |
| Allow | /shop-the-look/dsp/ |
| Allow | /shop-the-look/sl0 |
| Allow | /shop-the-look/sl1/ |
| Allow | /shop-the-look/sl2/ |
| Disallow | /shop-the-look/ |
| Disallow | /v/get_the_look/ |
| Disallow | /v/product_review_page/ |
| Disallow | /product_review_page/ |
| Disallow | /session/secure/ |
| Disallow | /asp/ |
| Disallow | /ib/ |
| Disallow | /param.xml |
| Disallow | /return_sales_items.php |
| Disallow | /session/public/board |
| Disallow | /Staples/ |
| Disallow | /v/category/show |
| Disallow | /a/favorites/list/is_favorited |
| Disallow | /a/performance_timing/log |
| Disallow | /b/batch |
| Disallow | /gateway.php |
| Disallow | /pixel/%21crd_prm%21.gif |
| Disallow | /set_location.php |
| Disallow | /v/category/get_top_level_categories |
| Disallow | /v/inventory/load |
| Disallow | /v/product_image_group/get_images |
| Disallow | /session/public/submit_review.php |
| Disallow | /session/public/basket.php |
| Disallow | /v/checkout/ |
| Disallow | /registry/browse/ |
| Disallow | /registry/checklist/ |
| Disallow | /v/ideaboards/ |
| Disallow | /v/favorites/ |
| Disallow | /compare.php |
| Disallow | /visual_search/ |
| Disallow | /finds |
| Disallow | /flashdeals |
| Disallow | /roomplanner/ |
| Disallow | /decorator/ |
| Disallow | /service_worker.js |
| Disallow | /registry/*/pdp/ |
| Allow | /roomplanner3d/$ |
| Disallow | /roomplanner3d/ |
| Disallow | /a/category/category_page/lazy_load_category_tree |
| Disallow | /*?*curpage=* |
Warnings
- `noindex` is not a known field.
Comments