to-be-dressed.nl
robots.txt
Robots Exclusion Standard data for to-be-dressed.nl
Resource Scan
Scan Details
| Site Domain | to-be-dressed.nl |
| Base Domain | to-be-dressed.nl |
| Scan Status | Ok |
| Last Scan | 2024-05-27T14:52:13+00:00 |
| Next Scan | 2024-06-26T14:52:13+00:00 |
Last Scan
| Scanned | 2024-05-27T14:52:13+00:00 |
| URL | https://to-be-dressed.nl/robots.txt |
| Redirect | https://www.to-be-dressed.nl/robots.txt |
| Redirect Domain | www.to-be-dressed.nl |
| Redirect Base | to-be-dressed.nl |
| Domain IPs | 104.21.88.225, 172.67.153.178, 2606:4700:3034::6815:58e1, 2606:4700:3035::ac43:99b2 |
| Redirect IPs | 104.21.88.225, 172.67.153.178, 2606:4700:3034::6815:58e1, 2606:4700:3035::ac43:99b2 |
| Response IP | 172.67.153.178 |
| Found | Yes |
| Hash | eaf25454ee03ce444b222c00c933531da583185caadd3d51747daeeb9f9f1676 |
| SimHash | 6b5ddc15c383 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /merchant/ |
| Disallow | /winkelier/ |
| Disallow | /open-bestelling-geplaatst.html |
| Disallow | /bestelling-geplaatst.html |
| Disallow | /404/ |
| Disallow | /supersale/ |
| Disallow | /home.html |
| Disallow | /wishlist-item/ |
| Disallow | /*/kleur_5/*kleur_5 |
| Disallow | /*/heren-maat_13/*heren-maat_13 |
| Disallow | /*/heren-xs-xxxl_3/*heren-xs-xxxl_3 |
| Disallow | /*/heren-xs-5xl_3/*heren-xs-5xl_3 |
| Disallow | /*/dames-xxs-xxxl_29/*dames-xxs-xxxl_29 |
| Disallow | /*/dames-maat_8/*dames-maat_8 |
| Disallow | /*/kinder-maat_9/*kinder-maat_9 |
| Disallow | /*/kinderschoenmaat_23/*kinderschoenmaat_23 |
| Disallow | /*/bh-omvang_15/*bh-omvang_15 |
| Disallow | /*/bh-cup_14/*bh-cup_14 |
| Disallow | /*/dames-schoenmaat_17/*dames-schoenmaat_17 |
| Disallow | /*/voetwijdte-dames_26/*voetwijdte-dames_26 |
| Disallow | /*/heren-schoenmaat_16/*heren-schoenmaat_16 |
| Disallow | /*/voetwijdte-heren_24/*voetwijdte-heren_24 |
| Disallow | /*/heren-jeans-maat_6/*heren-jeans-maat_6 |
| Disallow | /*/merk_1/*merk_1 |
| Disallow | /*/dames-jeans-maat_7/*dames-jeans-maat_7 |
| Disallow | /*/kleur-lens_35/*/kleur-lens_35 |
| Disallow | /*/unisex-xxs-xxxl_31/*/unisex-xxs-xxxl_31 |
| Disallow | /*/maat_41/*/maat_41 |
| Disallow | /*zoeken |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /merchant/ |
| Disallow | /winkelier/ |
| Disallow | /open-bestelling-geplaatst.html |
| Disallow | /bestelling-geplaatst.html |
| Disallow | /404/ |
| Disallow | /supersale/ |
| Disallow | /home.html |
| Disallow | /wishlist-item/ |
| Disallow | /*/kleur_5/*kleur_5 |
| Disallow | /*/heren-maat_13/*heren-maat_13 |
| Disallow | /*/heren-xs-xxxl_3/*heren-xs-xxxl_3 |
| Disallow | /*/heren-xs-5xl_3/*heren-xs-5xl_3 |
| Disallow | /*/dames-xxs-xxxl_29/*dames-xxs-xxxl_29 |
| Disallow | /*/dames-maat_8/*dames-maat_8 |
| Disallow | /*/kinder-maat_9/*kinder-maat_9 |
| Disallow | /*/kinderschoenmaat_23/*kinderschoenmaat_23 |
| Disallow | /*/bh-omvang_15/*bh-omvang_15 |
| Disallow | /*/bh-cup_14/*bh-cup_14 |
| Disallow | /*/dames-schoenmaat_17/*dames-schoenmaat_17 |
| Disallow | /*/voetwijdte-dames_26/*voetwijdte-dames_26 |
| Disallow | /*/heren-schoenmaat_16/*heren-schoenmaat_16 |
| Disallow | /*/voetwijdte-heren_24/*voetwijdte-heren_24 |
| Disallow | /*/heren-jeans-maat_6/*heren-jeans-maat_6 |
| Disallow | /*/merk_1/*merk_1 |
| Disallow | /*/dames-jeans-maat_7/*dames-jeans-maat_7 |
| Disallow | /*/kleur-lens_35/*/kleur-lens_35 |
| Disallow | /*/unisex-xxs-xxxl_31/*/unisex-xxs-xxxl_31 |
| Disallow | /*/maat_41/*/maat_41 |
| Disallow | /*zoeken |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.to-be-dressed.nl/sitemap.xml |