humblebundle.com
robots.txt

Robots Exclusion Standard data for humblebundle.com

Resource Scan

Scan Details

Site Domain humblebundle.com
Base Domain humblebundle.com
Scan Status Ok
Last Scan2025-12-05T17:10:01+00:00
Next Scan 2026-01-04T17:10:01+00:00

Last Scan

Scanned2025-12-05T17:10:01+00:00
URL https://humblebundle.com/robots.txt
Redirect https://www.humblebundle.com/robots.txt
Redirect Domain www.humblebundle.com
Redirect Base humblebundle.com
Domain IPs 104.18.39.232, 172.64.148.24
Redirect IPs 104.18.39.232, 172.64.148.24
Response IP 172.64.148.24
Found Yes
Hash 8acd987848510b3fda1513949edac6f902e3ae4d35d22e38df9a30d7e5091246
SimHash 70563b11c397

Groups

*

Rule Path
Disallow /?key*
Disallow /?s=thanks
Disallow /emailhelper
Disallow /delete-key
Disallow /download-lister
Disallow /store/product/*
Disallow /user/associate
Disallow /user/signup-complete
Disallow /widget/v2/*
Disallow /return-paypal
Disallow /return-billing-agreement-paypal
Disallow /return/
Disallow /*_escaped_fragment_%3Dsystem-requirements

addsearchbot
ai2bot
ai2bot-dolma
ai2bot-deepresearcheval
amazonbot
anchor browser
anthropic-ai
applebot
applebot-extended
atlassian-bot
autorag
awariosmartbot
bigsur.ai
big sur ai
brandwatch
bravebot
bytespider
ccbot
chatglm-spider
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
cotoyogi
datenbank crawler
ddm*
ddm-dcipher*
ddm-dcipher/1.0.7
deepseekbot
devin
diffbot
direqt anomura
duckassistbot
echobot bot
facebookbot
factset_spyderbot
gptbot
httrack
iask
icc-crawler
icc crawler
imagesiftbot
kangaroo bot
klaviyoaibot
kunato
liner bot
linerbot
meta-externalagent
meta-externalfetcher
meta-webindexer
mistral.ai
mistralai-user
netestate imprint crawler
novaact
novellum ai crawl
nutch
oai-searchbot
offline explorer
omgili
pangubot
perplexity-user
perplexitybot
petalbot
qualifiedbot
scrapy
seekrbot
semrushbotswa
semrushbot-ocob
shapbot
timpibot
velen crawler
velenpublicwebcrawler
webzio-extended
wrtn
youbot
zanistabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.humblebundle.com/sitemap.xml

Comments

  • Ziff Davis content is made available for your non-commercial use subject to our
  • Terms of Use here: https://www.humblebundle.com/terms
  • Use of any robot, crawler, or other tool to scrape, harvest, extract, or retrieve any content on
  • this website using automated means is prohibited without written permission from Ziff Davis.
  • Prohibited uses include but are not limited to:
  • (1) text and data mining under Art. 4 of the EU Directive on Copyright in the Digital Single
  • Market;
  • (2) development or operation of artificial intelligence or machine learning software or
  • databases, including by training, fine-tuning, embedding, and retrieval-augmented generation;
  • (3) creating data sets containing our content or sharing it with others; and
  • (4) any commercial purposes.
  • Contact licensing@ziffdavis.com for assistance.
  • Blocking known AI content scrapers

Warnings

  • 1 invalid line.