hollandandbarrett.nl
robots.txt
Robots Exclusion Standard data for hollandandbarrett.nl
Resource Scan
Scan Details
| Site Domain | hollandandbarrett.nl |
| Base Domain | hollandandbarrett.nl |
| Scan Status | Ok |
| Last Scan | 2024-09-20T04:31:32+00:00 |
| Next Scan | 2024-10-04T04:31:32+00:00 |
Last Scan
| Scanned | 2024-09-20T04:31:32+00:00 |
| URL | https://hollandandbarrett.nl/robots.txt |
| Redirect | https://www.hollandandbarrett.nl/robots.txt |
| Redirect Domain | www.hollandandbarrett.nl |
| Redirect Base | hollandandbarrett.nl |
| Domain IPs | 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:71e, 96.17.180.45, 96.17.180.51 |
| Redirect IPs | 23.215.7.31, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:71f |
| Response IP | 96.17.180.48 |
| Found | Yes |
| Hash | 734d279f7d74e92cf223948f5560532779dbc571c4e79d6a7c9f2fc02f449e2e |
| SimHash | 09de2be3c698 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /v1/widget* |
| Disallow | /basket/ |
| Disallow | /checkout/ |
| Disallow | /common/ |
| Disallow | /modules/ |
| Disallow | /template/ |
| Disallow | /emailtemplates/ |
| Disallow | /referentiemateriaal |
| Disallow | /api/pdp/images* |
| Disallow | /api/plp/global-layout* |
| Disallow | /api/social-messaging/ |
| Disallow | /shop/product/streams/media/ |
| Disallow | /rest/api/basket* |
| Disallow | /rest/api/session* |
| Disallow | /*browse* |
| Disallow | /*rating_* |
| Disallow | /*gender_* |
| Disallow | /*price_* |
| Disallow | /*size_* |
| Disallow | /*strength-mg* |
| Disallow | /*strength-iu* |
| Disallow | /*showAll%3D* |
| Disallow | /*skupromo_* |
| Disallow | /*strength-g_less-than* |
| Disallow | /*strength-c_less-than* |
| Disallow | /*strength-ml_less-than* |
| Disallow | /*sort_ratings* |
| Disallow | /*sort_high-low* |
| Disallow | /*sort_low-high* |
| Disallow | /*sort_a-to-z* |
| Disallow | /*sort_z-to-a* |
| Disallow | /*sort_topseller* |
| Disallow | /*N%3D* |
| Disallow | /_next/static* |
| Disallow | /auth/ |
| Disallow | /*brandId%3D* |
| Disallow | /*bvroute%3D* |
| Disallow | /*bvstate%3D* |
| Disallow | /*cat%3D* |
| Disallow | /*isOneSearchMVT%3D* |
| Disallow | /*limit%3D* |
| Disallow | /*page-sort%3D* |
| Disallow | /*SID%3D* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.svg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | /*.js* |
| Allow | /*.css* |
| Allow | /*.jpg* |
| Allow | /*.jpeg* |
| Allow | /*.svg* |
| Allow | /*.gif* |
| Allow | /*.png* |
| Allow | /*?t=skupromo_all |
| Allow | /_next/static/*.js |
| Allow | /_next/static/*.css |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hollandandbarrett.nl/sitemap.xml |
Comments