shop.vtwonen.nl
robots.txt
Robots Exclusion Standard data for shop.vtwonen.nl
Resource Scan
Scan Details
| Site Domain | shop.vtwonen.nl |
| Base Domain | vtwonen.nl |
| Scan Status | Ok |
| Last Scan | 2024-09-17T18:47:34+00:00 |
| Next Scan | 2024-10-17T18:47:34+00:00 |
Last Scan
| Scanned | 2024-09-17T18:47:34+00:00 |
| URL | https://shop.vtwonen.nl/robots.txt |
| Domain IPs | 104.22.40.79, 104.22.41.79, 172.67.39.186, 2606:4700:10::6816:284f, 2606:4700:10::6816:294f, 2606:4700:10::ac43:27ba |
| Response IP | 172.67.39.186 |
| Found | Yes |
| Hash | 53dc21e9b2b2cd9ccb6e7cfaa89c2adbb4e34b0542a7401721c10f443ec59f8d |
| SimHash | 4745c5176968 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /producten/*?*_fk_ |
| Disallow | /producten/merk-*/merk-*/* |
| Disallow | /producten/*/merk-*/merk-*/* |
| Disallow | /zoek/* |
| Disallow | /compare/* |
| Disallow | /verlanglijst/* |
| Disallow | /orderreview/* |
| Disallow | /orderreview2/* |
| Disallow | /winkelwagen/* |
| Disallow | /bestellen/* |
| Disallow | /cart/* |
| Disallow | /Exports/* |
| Disallow | /remote/features/accountincentive/ |
| Disallow | /remote/features/foreigncountry/ |
| Disallow | /preferences/* |
| Disallow | /seller/seller-contact/* |
| Disallow | /seller/seller-contact-success/* |
| Disallow | /seller/seller-contact-order/* |
| Disallow | /seller/seller-contact-order-success/* |
| Disallow | /klantenservice/zoeken/* |
| Disallow | /klantendienst/zoeken/* |
| Disallow | /stylingtool/?* |
| Disallow | /*?*fq=* |
| Disallow | /producten/*?*sort=* |
| Allow | /producten/categorie-*/?ms_fk_kleur=* |
| Disallow | /producten/categorie-*/?ms_fk_kleur=*&* |
| Disallow | /producten/categorie-*/?ms_fk_kleur=*%2C* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shop.vtwonen.nl/sitemap/ |
| sitemap | https://shop.vtwonen.nl/sitemap/attributes/ |