to-be-dressed.nl
robots.txt
Robots Exclusion Standard data for to-be-dressed.nl
Resource Scan
Scan Details
Site Domain | to-be-dressed.nl |
Base Domain | to-be-dressed.nl |
Scan Status | Ok |
Last Scan | 2024-09-24T14:53:26+00:00 |
Next Scan | 2024-10-24T14:53:26+00:00 |
Last Scan
Scanned | 2024-09-24T14:53:26+00:00 |
URL | https://to-be-dressed.nl/robots.txt |
Redirect | https://www.to-be-dressed.nl/robots.txt |
Redirect Domain | www.to-be-dressed.nl |
Redirect Base | to-be-dressed.nl |
Domain IPs | 104.21.88.225, 172.67.153.178, 2606:4700:3034::6815:58e1, 2606:4700:3035::ac43:99b2 |
Redirect IPs | 104.21.88.225, 172.67.153.178, 2606:4700:3034::6815:58e1, 2606:4700:3035::ac43:99b2 |
Response IP | 172.67.153.178 |
Found | Yes |
Hash | eaf25454ee03ce444b222c00c933531da583185caadd3d51747daeeb9f9f1676 |
SimHash | 6b5ddc15c383 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /merchant/ |
Disallow | /winkelier/ |
Disallow | /open-bestelling-geplaatst.html |
Disallow | /bestelling-geplaatst.html |
Disallow | /404/ |
Disallow | /supersale/ |
Disallow | /home.html |
Disallow | /wishlist-item/ |
Disallow | /*/kleur_5/*kleur_5 |
Disallow | /*/heren-maat_13/*heren-maat_13 |
Disallow | /*/heren-xs-xxxl_3/*heren-xs-xxxl_3 |
Disallow | /*/heren-xs-5xl_3/*heren-xs-5xl_3 |
Disallow | /*/dames-xxs-xxxl_29/*dames-xxs-xxxl_29 |
Disallow | /*/dames-maat_8/*dames-maat_8 |
Disallow | /*/kinder-maat_9/*kinder-maat_9 |
Disallow | /*/kinderschoenmaat_23/*kinderschoenmaat_23 |
Disallow | /*/bh-omvang_15/*bh-omvang_15 |
Disallow | /*/bh-cup_14/*bh-cup_14 |
Disallow | /*/dames-schoenmaat_17/*dames-schoenmaat_17 |
Disallow | /*/voetwijdte-dames_26/*voetwijdte-dames_26 |
Disallow | /*/heren-schoenmaat_16/*heren-schoenmaat_16 |
Disallow | /*/voetwijdte-heren_24/*voetwijdte-heren_24 |
Disallow | /*/heren-jeans-maat_6/*heren-jeans-maat_6 |
Disallow | /*/merk_1/*merk_1 |
Disallow | /*/dames-jeans-maat_7/*dames-jeans-maat_7 |
Disallow | /*/kleur-lens_35/*/kleur-lens_35 |
Disallow | /*/unisex-xxs-xxxl_31/*/unisex-xxs-xxxl_31 |
Disallow | /*/maat_41/*/maat_41 |
Disallow | /*zoeken |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
googlebot
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /merchant/ |
Disallow | /winkelier/ |
Disallow | /open-bestelling-geplaatst.html |
Disallow | /bestelling-geplaatst.html |
Disallow | /404/ |
Disallow | /supersale/ |
Disallow | /home.html |
Disallow | /wishlist-item/ |
Disallow | /*/kleur_5/*kleur_5 |
Disallow | /*/heren-maat_13/*heren-maat_13 |
Disallow | /*/heren-xs-xxxl_3/*heren-xs-xxxl_3 |
Disallow | /*/heren-xs-5xl_3/*heren-xs-5xl_3 |
Disallow | /*/dames-xxs-xxxl_29/*dames-xxs-xxxl_29 |
Disallow | /*/dames-maat_8/*dames-maat_8 |
Disallow | /*/kinder-maat_9/*kinder-maat_9 |
Disallow | /*/kinderschoenmaat_23/*kinderschoenmaat_23 |
Disallow | /*/bh-omvang_15/*bh-omvang_15 |
Disallow | /*/bh-cup_14/*bh-cup_14 |
Disallow | /*/dames-schoenmaat_17/*dames-schoenmaat_17 |
Disallow | /*/voetwijdte-dames_26/*voetwijdte-dames_26 |
Disallow | /*/heren-schoenmaat_16/*heren-schoenmaat_16 |
Disallow | /*/voetwijdte-heren_24/*voetwijdte-heren_24 |
Disallow | /*/heren-jeans-maat_6/*heren-jeans-maat_6 |
Disallow | /*/merk_1/*merk_1 |
Disallow | /*/dames-jeans-maat_7/*dames-jeans-maat_7 |
Disallow | /*/kleur-lens_35/*/kleur-lens_35 |
Disallow | /*/unisex-xxs-xxxl_31/*/unisex-xxs-xxxl_31 |
Disallow | /*/maat_41/*/maat_41 |
Disallow | /*zoeken |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.to-be-dressed.nl/sitemap.xml |