BottleCapAI

112 posts

BottleCapAI banner
BottleCapAI

BottleCapAI

@BottleCapAI

Making efficiency-first LLMs & Applications.

Katılım Şubat 2025
6 Takip Edilen2.9K Takipçiler
Sabitlenmiş Tweet
BottleCapAI
BottleCapAI@BottleCapAI·
🚨Introducing efficiency focused “ThinkingCap” AI model series.  Starting with 2× thinking token reduction on average in Qwen 3.6 27B, with up to 10x faster generation on individual examples. Now available on HuggingFace!
English
11
9
90
7.6K
TonoKen3🏯Local LLM&Infrastructure Architect🚀とのけん
BottlecAIよりThinkingCap-Qwen3.6-27B-FP8がリリースされた。リリース即300KダウンロードされたThinking長さを半減以下しつつ賢さ維持という特徴を持つモデルの8ビット版だ vLLMで動かすことができるというので、これは是非試したい。さらに明瞭簡潔かもしれないぞ! huggingface.co/bottlecapai/Th…
日本語
4
10
37
3.8K
Hugging Models
Hugging Models@HuggingModels·
Ever wished your AI could think ahead and save tokens? Meet ThinkingCap-Qwen3.6-27B, a GGUF model that uses Multi-Token Prediction (MTP) and speculative decoding to generate faster and smarter. It's a game changer for token efficiency.
Hugging Models tweet media
English
2
5
45
3.3K
Vibe Coding with Gene
Vibe Coding with Gene@with_gene2626·
Best version of Qwen 3.6 27B yet, imho... Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4. So what makes it different from other 27B quants? * ThinkingCap finetune cuts thinking tokens ~46% with no accuracy loss. Less rambling, same answers. It's abliterated (uncensored) so there is no refusal filter. * NVFP4 W4A4 quantization so it's a mere 20.6 GB, fits on a single 24 GB card. vLLM 0.21+ auto-detects it. * Vision tower kept in bf16 so it is still multimodal! * MTP speculative decoding head kept in bf16. It allows vLLM to draft 3 tokens ahead for faster generation. * Full 128K context at TP=2 (hybrid attention KV is lighter). Many other 27B quants are just the base model compressed. This one stacks shorter reasoning + uncensored + 4-bit + spec decode + vision into one download. Incredible work @support_huihui and @Tono_Ken3
TonoKen3🏯Local LLM&Infrastructure Architect🚀とのけん@Tono_Ken3

公開からわずか2日間で30万ダウンロードされたQwen3.6-27bを賢いままで最大90%Thinkingを切り詰めるThinkingCapにHuihuiさんが無検閲化加工を施した! これは最強タッグなので早速NVFP4にて焼きました。私はメインで使います モデルファイルは20GB強です huggingface.co/sakamakismile/…

English
2
4
49
9.2K
Martin Vitalos
Martin Vitalos@MalyVitaloshnik·
@BottleCapAI Are you planning your official API as well? Even with my unoptimized setup it feels like there could be pretty good margins to support your research :D
English
1
0
0
19
BottleCapAI
BottleCapAI@BottleCapAI·
No GPU needed. ThinkingCap Qwen3.6-27B (FP8) is now available to everyone through a simple API on Requesty!
BottleCapAI tweet media
English
3
2
39
3.8K
BottleCapAI
BottleCapAI@BottleCapAI·
Why through Requesty: - OpenAI-compatible API: integrate in 3 lines of code, works with the SDK you already use - Production-ready from day one: 99.99% uptime, automatic failover, EU data residency - Full cost control: real-time analytics, caching, and spending limits built in Launch pricing: $0.40 per million input tokens, $3.00 per million output tokens.
English
2
0
5
430
Benjamin Marie
Benjamin Marie@bnjmn_marie·
ThinkingCap-Qwen3.6-27B is really good. Much faster than the original Qwen3.6-27B thanks to shorter thinking, while preserving accuracy. Also one of the best evaluation I have seen for a custom Qwen3.6 27B: lot of benchmarks, sigtest, token count, etc. That's all very convincing. I'll publish my own evaluations for this model soon.
English
22
16
318
39.2K