humblebundle.com
robots.txt
Robots Exclusion Standard data for humblebundle.com
Resource Scan
Scan Details
| Site Domain | humblebundle.com |
| Base Domain | humblebundle.com |
| Scan Status | Ok |
| Last Scan | 2025-12-05T17:10:01+00:00 |
| Next Scan | 2026-01-04T17:10:01+00:00 |
Last Scan
| Scanned | 2025-12-05T17:10:01+00:00 |
| URL | https://humblebundle.com/robots.txt |
| Redirect | https://www.humblebundle.com/robots.txt |
| Redirect Domain | www.humblebundle.com |
| Redirect Base | humblebundle.com |
| Domain IPs | 104.18.39.232, 172.64.148.24 |
| Redirect IPs | 104.18.39.232, 172.64.148.24 |
| Response IP | 172.64.148.24 |
| Found | Yes |
| Hash | 8acd987848510b3fda1513949edac6f902e3ae4d35d22e38df9a30d7e5091246 |
| SimHash | 70563b11c397 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /?key* |
| Disallow | /?s=thanks |
| Disallow | /emailhelper |
| Disallow | /delete-key |
| Disallow | /download-lister |
| Disallow | /store/product/* |
| Disallow | /user/associate |
| Disallow | /user/signup-complete |
| Disallow | /widget/v2/* |
| Disallow | /return-paypal |
| Disallow | /return-billing-agreement-paypal |
| Disallow | /return/ |
| Disallow | /*_escaped_fragment_%3Dsystem-requirements |
addsearchbot
ai2bot
ai2bot-dolma
ai2bot-deepresearcheval
amazonbot
anchor browser
anthropic-ai
applebot
applebot-extended
atlassian-bot
autorag
awariosmartbot
bigsur.ai
big sur ai
brandwatch
bravebot
bytespider
ccbot
chatglm-spider
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
cotoyogi
datenbank crawler
ddm*
ddm-dcipher*
ddm-dcipher/1.0.7
deepseekbot
devin
diffbot
direqt anomura
duckassistbot
echobot bot
facebookbot
factset_spyderbot
gptbot
httrack
iask
icc-crawler
icc crawler
imagesiftbot
kangaroo bot
klaviyoaibot
kunato
liner bot
linerbot
meta-externalagent
meta-externalfetcher
meta-webindexer
mistral.ai
mistralai-user
netestate imprint crawler
novaact
novellum ai crawl
nutch
oai-searchbot
offline explorer
omgili
pangubot
perplexity-user
perplexitybot
petalbot
qualifiedbot
scrapy
seekrbot
semrushbotswa
semrushbot-ocob
shapbot
timpibot
velen crawler
velenpublicwebcrawler
webzio-extended
wrtn
youbot
zanistabot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.humblebundle.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments