Post

Sam L
Sam L@samelldev·
HUGE milestone! 😄 from a barebones Buildroot image to the first successful GPU inference test run with llama.cpp - qwen2.5 i have a massive smile on my face right now 😅
Sam L tweet media
English
3
3
13
1K
Sam L
Sam L@samelldev·
should have it wired into KruxChat and KruxCode by the end of tomorrow for fully local-on-box inference on @KruxOS_ and then need to work on the driver support for more hardware
English
1
0
1
43
KruxOS
KruxOS@KruxOS_·
@samelldev 😁🥹 Local inference for the people!
English
0
0
1
9
Paylaş