hollandandbarrett.ie
robots.txt

Robots Exclusion Standard data for hollandandbarrett.ie

Resource Scan

Scan Details

Site Domain hollandandbarrett.ie
Base Domain hollandandbarrett.ie
Scan Status Ok
Last Scan2024-06-02T18:29:54+00:00
Next Scan 2024-07-02T18:29:54+00:00

Last Scan

Scanned2024-06-02T18:29:54+00:00
URL https://hollandandbarrett.ie/robots.txt
Redirect https://www.hollandandbarrett.ie/robots.txt
Redirect Domain www.hollandandbarrett.ie
Redirect Base hollandandbarrett.ie
Domain IPs 23.52.171.201, 23.59.168.155, 2600:1413:b000:1c::17d1:2ecf, 2600:1413:b000:1c::17d1:2ee3
Redirect IPs 23.52.171.209, 23.59.168.177, 2600:1417:3f::b81c:eb62, 2600:1417:3f::b81c:eb63
Response IP 23.52.171.209
Found Yes
Hash 11a8f540faaf486fdb7b0ab8dda7ff4f05e8bbbdc68abfcd4300b8d302a74ae0
SimHash 091c6ba2df90

Groups

*

Rule Path
Allow /*sort_new-in*
Disallow /*t%3D*%7C*
Disallow /v1/widget*
Disallow /basket/
Disallow /checkout/
Disallow /common/
Disallow /modules/
Disallow /template/
Disallow /emailtemplates/
Disallow /healthbox/
Disallow /my-account/
Disallow /auth/
Disallow /cartridges/
Disallow /*shop/gs/*
Disallow /*en-us/shop/gs/*
Disallow /*en-au/shop/gs/*
Disallow /*search/?isSearch=true&query=*
Disallow /*gclid%3D*
Disallow /*dclid%3D*
Disallow /*page-sort%3D*
Disallow /*browse*
Disallow /*rating_*
Disallow /*gender_*
Disallow /*price_*
Disallow /*size_*
Disallow /*strength-mg*
Disallow /*strength-iu*
Disallow /*showAll%3D*
Disallow /*skupromo_*
Disallow /*strength-c_less-than*
Disallow /*sort_ratings*
Disallow /*sort_high-low*
Disallow /*sort_low-high*
Disallow /*sort_a-to-z*
Disallow /*sort_z-to-a*
Disallow /*sort_topseller*
Disallow /*N%3D*
Disallow /*q%3D*
Disallow /*bvstate*
Disallow /*bvroute*
Disallow /_next/static*
Disallow /*query*
Disallow /*isSearch*
Disallow /*isOneSearchMVT*
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.jpeg
Allow /*.svg
Allow /*.gif
Allow /*.png
Allow /*.js*
Allow /*.css*
Allow /*.jpg*
Allow /*.jpeg*
Allow /*.svg*
Allow /*.gif*
Allow /*.png*

adidxbot

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.hollandandbarrett.com/sitemap.xml

Comments

  • Website Sitemap
  • Crawlers Setup
  • Paths (no clean URLs)
  • allow all resources