
TotallyArea
556 posts




DEVS, would you be interested in a SPECIALIZED AI model to assist with coding? not a wrapper, API or subscription. download and run it for 100% FREE, 100% PRIVATE. small enough to run on even on a laptop, designed to help with everyday lua tasks. 👇👇 Oppoah Type 9B (Preview)








running a 405-billion-parameter model used to mean a $30,000 GPU rack. one developer made it run on a single 8GB card the kind that's been sitting in gaming laptops for years. it's called AirLLM, and the trick is almost stupidly simple: instead of loading the whole model, it keeps one layer on the GPU at a time and streams the rest through. / Llama 3.1 405B on 8GB / DeepSeek-V3, all 671B of it, on about 12GB / no quantization, no distillation, no pruning the full-precision model / works with Llama, Qwen, DeepSeek, Mistral, Gemma, and more it's Apache 2.0 and already past 22,600 stars. → github.com/lyogavin/airllm bookmark it.

















