Sabitlenmiş Tweet
THIS GUY BUILT A FULLY LOCAL AI ASSISTANT THAT FITS IN YOUR HAND AND DOESN'T COST A CENT TO RUN
everyone's paying $20/mo for ChatGPT and praying their data isn't being sold somewhere
he just built his own. runs entirely on a raspberry pi, completely offline, 100% private
he calls it Pocket
here's how it works:
1\ you talk to it, fast whisper transcribes your voice locally
2\ a small router model decides if your question is simple or complex
3\ simple stuff goes to qwen non-thinking mode (instant reply)
4\ complex stuff goes to qwen with thinking mode on (slower but smart)
5\ piper tts speaks the answer back to you
the stack:
> raspberry pi 5 (16gb ram) as the main brain
> qwen as the reasoning model with thinking on/off routing
> function gemma 270m for tool calls, fine-tuned on his own dataset
> fast whisper for speech to text
> piper tts medium for text to speech
> hailo 8 hat to run computer vision without bogging down the pi
> 4.3 inch touchscreen with custom ui
> two 18650 batteries for 1-2 hours of untethered use
> 3d printed case with ventilation because the whole thing runs hot
the smart part is the routing. you don't want every "hello, how are you" going through a 19-second thinking process. so simple prompts skip thinking entirely, complex ones get the full reasoning
but the real kicker is the tool calling. function gemma is only 270m parameters which means it loads in milliseconds. he fine-tuned it on his own functions and got it to 100% accuracy on his test set
so now Pocket can pull live weather, search the web, scan your local network for unknown devices, check stock prices, all running locally with one tiny model doing the function selection
he also added scheduled tasks. you can tell it to fetch the weather in atlanta every morning at 7am and it just does it. no cloud cron, no subscription, no api keys
and because there's a camera + the hailo hat, you press one button and it does real-time object detection without touching the language models
if you've been waiting for a personal AI that isn't owned by openai or anthropic or google, this is the blueprint
he open sourced the whole thing. the code, the CAD files, the fine-tuning data
you can build your own this weekend
English
