PrismML

223 posts

PrismML banner
PrismML

PrismML

@PrismML

Centering AI research on efficiency. https://t.co/88MQHGCeFD

United States Katılım Mart 2025
27 Takip Edilen16.1K Takipçiler
Sabitlenmiş Tweet
PrismML
PrismML@PrismML·
Today, we’re announcing Bonsai 27B: the first 27B-class model to run on a phone. Bonsai 27B is the new multimodal flagship of the Bonsai family. Based on Qwen3.6 27B, it brings a new capability tier to local AI: multi-step reasoning, structured tool use, long-context workflows, and coherent agentic loops. Until now, models in this class have been impractical to deploy locally. A 27B model occupies roughly 54 GB in 16-bit precision, and even a strong 4-bit build is around 18GB - too large for a phone and for most laptops. Bonsai 27B changes that. It comes in two variants: • Ternary Bonsai 27B: 5.9 GB, 1.71 effective bits per weight, optimized for laptop-class quality. • 1-bit Bonsai 27B: 3.9 GB, 1.125 effective bits per weight, optimized for phone-class footprint. Everything is open-sourced today under the Apache 2.0 license.
PrismML tweet media
English
302
970
5.9K
1.4M
PrismML retweetledi
Thomas Konings
Thomas Konings@tkon99·
Finally had the time to test Bonsai by @PrismML out. On my mere RTX 4070 Super I get 45 t/s output. Quick addition to ZCode and it's building websites, the thing is incredibly agentic for the hardware it's running on! It's going to be an awesome year for Local AI.
Thomas Konings tweet media
Thomas Konings@tkon99

This chart from the Bonsai model release by @PrismML will be all over LinkedIn tomorrow :) Intelligence density is going to be a huge benchmark going forward, matching the incentives created by memory shortages. Imagine harnessing all the memory we have out and about already.

English
2
2
8
1.8K
PrismML retweetledi
Maziyar PANAHI
Maziyar PANAHI@MaziyarPanahi·
I finally got GLM-5.2 to work an entire 3-year patient chart that only Bonsai 27B was allowed to read 🔥 292 encounters live inside Bonsai on my Mac Studio. llama.cpp, Metal, ternary, 7.2GB, Apache-2.0. The chart never leaves the machine. GLM-5.2 can only ask questions. It asked three. Bonsai answered each in ~2s with 19,398 tokens still cached. Then it caught the thing buried 17 months back: metformin + iodinated contrast at eGFR 39. Nephrology warned about it in 2025. The ED booked the CT anyway. A 27B-class model used to need a datacentre. @PrismML say the 1-bit build is 3.9GB and fits an iPhone 17 Pro Max. The orchestrator never touched the data. That's the whole point. What should it read next?
English
30
40
472
51.2K
PrismML retweetledi
Ahmad
Ahmad@TheAhmadOsman·
Been playing with @PrismML's new model that turned Qwen 3.5 27B into a sub-4GB and sub-6GB weights and I am impressed Cannot believe how far Opensource and Local AI have come since Christmas (~8 months ago)
English
24
21
469
22.4K
PrismML retweetledi
PrismML retweetledi
sabesh 📟
sabesh 📟@sabeshbharathi·
Plugged in @PrismML’s Bonsai 27B 1-Bit on iOS with a custom-made agents orchestrator to help me perform agentic tasks, on-device. For instance, in this example: > Bonsai looks through my contacts > Finds an email > Drafts email body > AND sends it too. All using a 27B class model running on an iPhone 17 Pro. It’s crazy that we are able to achieve ~89% of Qwen’s 27B intelligence running natively on an iPhone, not just for conversations but ACTUALLY doing agentic tasks. This validates all the experiments we’ve been undertaking at making models smaller, and more efficient!
English
6
10
107
8.8K
PrismML retweetledi
t.toda
t.toda@Trtd6Trtd·
話題のBonsai 27BをQwen 3.6と比較 めちゃ早いし出力もそんなに差がなさそうに見える
t.toda@Trtd6Trtd

archive.is/20260711063417… BonsaiのPrismMLがQwen 3.7 27Bを圧縮してiPhone 17 Pro上で動作させたそう 発熱えぐそうだが大丈夫なのかしら

日本語
7
30
247
47.6K
PrismML retweetledi
Alice The Ai Expert
Alice The Ai Expert@AliceInfoAi·
@PrismML Bonsai 27B. Phone-size. Desktop power. Running 27B reasoning + tools locally is wild. Open source too
English
0
1
10
1.6K
PrismML retweetledi
PrismML retweetledi
PrismML retweetledi
PrismML retweetledi
PrismML retweetledi
PrismML retweetledi
Ion Stoica
Ion Stoica@istoica05·
@PrismML Impressive systems engineering achievement to enable powerful on-device AI.
English
0
4
15
2.3K
PrismML retweetledi
PrismML retweetledi
Mia
Mia@MiaAI_lab·
Ternary-Bonsai-27B Q2 by @PrismML is actually... good?! Only at first run but look at the results 🤯 Even DeepSeek v4 Flash and the Qwen3.6 27b failed on some of these tests...
Mia tweet media
English
48
58
717
63.3K
PrismML retweetledi
PrismML retweetledi
PrismML retweetledi