Hybrid 🏃🏾
79K posts

Hybrid 🏃🏾
@_markfenner
Security & Risk👨🏾💻 | Causing trouble with @DevinAI 🤖 | 🧑🏾🍳 @pushculture_









i'd love to see interesting things people have built with 5.6 sol. i will send the person who made the coolest thing a special gift from the openai archives.



Don't dare bury RTX 3090 until you read this! @UnslothAI shipped two new 4-bit quants of qwen3.6-35b this week. i spent the night racing them against awq on my 4x3090 to find the fastest one. nvfp4, nvfp4-fast and awq land within 17% on decode, ~3% on prefill, and within 3 points on gpqa, mmlu-pro and code. the format war is a draw. the 3090 has no fp4 units, so vllm runs every one as w4a16 on marlin. "fast" has nothing to run on. then i flipped the mtp head that ships inside the checkpoint. 173 -> 246 tok/s ⚡, +41%, it accepted 95% still beast

















