wayfair.de
robots.txt
Robots Exclusion Standard data for wayfair.de
Resource Scan
Scan Details
| Site Domain | wayfair.de |
| Base Domain | wayfair.de |
| Scan Status | Ok |
| Last Scan | 2024-11-13T07:15:43+00:00 |
| Next Scan | 2024-11-20T07:15:43+00:00 |
Last Scan
| Scanned | 2024-11-13T07:15:43+00:00 |
| URL | https://wayfair.de/robots.txt |
| Redirect | https://www.wayfair.de/robots.txt |
| Redirect Domain | www.wayfair.de |
| Redirect Base | wayfair.de |
| Domain IPs | 151.101.1.252, 151.101.129.252, 151.101.193.252, 151.101.65.252 |
| Redirect IPs | 104.18.37.178, 172.64.150.78 |
| Response IP | 104.18.37.178 |
| Found | Yes |
| Hash | 2fffb50f9dad63f55f344204b6fc1c11a93be228359d13a70ff792482901d189 |
| SimHash | 4d2415a31717 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /a/account/ |
| Disallow | /a/category/category_page/lazy_load_category_tree |
| Allow | /a/daily_sales/solr_event/ |
| Disallow | /a/favorites/ |
| Disallow | /a/logging/js |
| Disallow | /a/performance_timing/log* |
| Disallow | /a/performance_timing/log_frontend_data |
| Disallow | /a/performance_timing/log_tti_data |
| Disallow | /a/wf_auth/authentication/log_frontend_event_data |
| Disallow | /b/batch |
| Disallow | /*?*curpage=* |
| Disallow | /filter/ |
| Disallow | /filters/ |
| Disallow | */filters/ |
| Disallow | /*%26filters%3D* |
| Disallow | /finds |
| Disallow | /gateway.php |
| Disallow | /v/inventory/load |
| Disallow | /log.php |
| Disallow | /logjs.php |
| Disallow | /logodownload.php |
| Disallow | /*_pageId%3D* |
| Disallow | /param.xml |
| Disallow | /pixel/%21crd_prm%21.gif |
| Disallow | /product_review_page/ |
| Disallow | /session/public/basket.php |
| Disallow | /session/secure/account/rewards_signup.php |
| Disallow | /service_worker.js |
| Disallow | /shop/ |
| Disallow | /shop-the-look/ |
| Disallow | /*?source=* |
| Disallow | /v/account/ |
| Disallow | /v/category/get_top_level_categories |
| Disallow | /v/category/show |
| Disallow | /v/checkout/ |
| Disallow | /v/favourites |
| Disallow | /v/inspiration_gallery/photo_products |
| Disallow | /v/product_review_page/ |
| Disallow | /v/sales_chat/ |