buff.com
robots.txt

Robots Exclusion Standard data for buff.com

Resource Scan

Scan Details

Site Domain buff.com
Base Domain buff.com
Scan Status Ok
Last Scan2026-01-10T05:45:12+00:00
Next Scan 2026-02-09T05:45:12+00:00

Last Scan

Scanned2026-01-10T05:45:12+00:00
URL https://www.buff.com/robots.txt
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.113.124
Found Yes
Hash 3b1bb78500cea590f27f632b90ab6647ba6d01987395be0b45082cd3b2865cf4
SimHash 09a69d18abba

Groups

*
googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow */us/neckwear/shopby/survivor.html
Disallow */us/neckwear/shopby/coolnet.html
Disallow */us/neckwear/shopby/fishing.html
Disallow */us/neckwear/shopby/cycling.html
Disallow */us/neckwear/shopby/merino_wool.html
Disallow */us/neckwear/shopby/ski_snowboard.html
Disallow */us/neckwear/shopby/dog.html
Disallow */us/neckwear/shopby/man.html
Disallow */us/neckwear/shopby/woman.html
Disallow */es_es/catalogo/shopby/oportunidades.html
Disallow */es_es/catalogo/shopby/running.html
Disallow */es_es/catalogo/shopby/lana_merino.html
Disallow */fr_eur/catalogue-produits/shopby/laine_merinos.html
Disallow */fr_eur/tete/shopby/enfant.html
Disallow */de_eur/katalog/shopby/merinowolle.html
Disallow */ca/neckwear/shopby/survivor.html
Disallow */gb/all/shopby/merino_wool.html
Disallow */my-account
Disallow */search
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */account/
Disallow /*SID%3D%E2%80%9D
Disallow */shopby/
Disallow /*?customFilters
Disallow /*?priceMin
Disallow /*?priceMax
Disallow /*?sortKey
Disallow /*?sortDirection
Disallow /*?size=

Other Records

Field Value
sitemap https://www.buff.com/media/sitemap_en_eur.xml
sitemap https://www.buff.com/media/sitemap_ca.xml
sitemap https://www.buff.com/media/sitemap_de_eur.xml
sitemap https://www.buff.com/media/sitemap_nl_eur.xml
sitemap https://www.buff.com/media/sitemap_fr_eur.xml
sitemap https://www.buff.com/media/sitemap_gb.xml
sitemap https://www.buff.com/media/sitemap_es_es.xml
sitemap https://www.buff.com/media/sitemap_ca_es.xml
sitemap https://www.buff.com/media/sitemap_north_en.xml
sitemap https://www.buff.com/media/sitemap_north_es.xml
sitemap https://www.buff.com/media/sitemap_south_es.xml
sitemap https://www.buff.com/media/sitemap_south_en.xml
sitemap https://www.buff.com/media/sitemap_us.xml
sitemap https://www.buff.com/safety/sitemap_index.xml
sitemap https://www.buff.com/blog/en/sitemap.xml
sitemap https://www.buff.com/blog/fr/sitemap.xml
sitemap https://www.buff.com/blog/es/sitemap.xml
sitemap https://www.buff.com/blog/de/sitemap.xml
sitemap https://www.buff.com/blog/ca/sitemap.xml

Comments

  • Crawlers Setup
  • Directories
  • Paths
  • Disallow: */checkout Removed due to JS blocked on HP
  • Parameters to prevent server overload
  • Sitemaps
  • Safety
  • Blog