John Song
335 posts
@AtlasInference @spark_arena How about 27B? How many token per second at decoding
English
DGX Spark just benched 200+ tok/s for Qwen3.6-35B with @AtlasInference on @spark_arena 🔥
How's that possible? Providers like Codex and Claude get ~60. Other major engines don't come close 🦥
We haven't seen speeds like this on GB10. NO ONE HAS. Atlas is shattering records 🚀
English
@takayan660 True. With this requirement, yes dgx spark is a better option.
English
Spent $3998.98 total to have 96gb of VRAM using AMD's AI Pro R9700 Cards. (brand new)
Comparatively I had spent $1520.00 on two used RX 7900 XTX's for 48gb of VRAM.
If ur team RED, a single XTX is CHEAPER than
a RTX 3090.
Should I have bought a Mac or DGX Spark instead?
English
@JJJOOOHN In theory you can do stuff like this: github.com/vosen/ZLUDA
What CUDA based projects are you running?
English
i declare qwen 3.6 27b dense q4 the king of a single rtx 3090 card. not even close.
this model is absolute beast on local ai, ruthless on agentic loops, owns its own thinking. anyone can use it on single 3090, the weights are open, the stack is reproducible, the prompt is canonical, every claim below is verifiable on your own hardware.
the octopus invaders one shot you are seeing is the visible test. i run these models on workloads you wouldn't think to ask for and i couldn't show you if i wanted to, and qwen 3.6 27b dense q4 quietly does the heavy lifting on a single consumer card while the rest of the field is busy explaining why it cannot.
if you think a different model is king on a single 3090 right now, name it. drop your card, drop your model, drop your numbers. the throne is not crowded.
Sudo su@sudoingX
update: qwen 3.6 27b dense q4 just one shotted octopus invaders game on a single 3090. hermes agent drove the whole thing, ~41 tok/s gen 21gb vram at full 262k context, thinking mode on. one prompt in and the canonical multi-file space shooter benchmark out, the same exact prompt i ran on qwen 3.5 27b dense back in march on the same card. 3.5 needed one external scope bug fix before the game would even load on first play. 3.6 needed nothing. 11 of 11 files written, 2411 lines of code, zero steering interventions, zero external fixes, playable on first load. 16 minutes 41 seconds wall clock from prompt to playable. consumer tier king on a single 3090 is locked tonight, and the silicon underneath my desk did not change between march and now. the open source ecosystem just moved the floor. watch it ship itself, the full 16 minutes 41 seconds sped to 3 minutes 45, no human touched the keyboard between the first prompt and the final frame.
English
this is what my setup looks like today. about to test qwen 3.6 27b dense q4 on a single rtx 3090 at ~41 tok/s gen, hermes agent driving.
predecessor model qwen 3.5 dense q4 made it work in one iteration when i ran the same agentic build on the same card. i've been daily driving qwen 3.6 27b dense for weeks now, the model i keep coming back to.
if 3.6 oneshots too, this becomes the best model that runs on a single rtx 3090. consumer tier king. firing the test now will report back soon.
English
English
@JJJOOOHN @SpaceTimeViking @nvidia that's literally what i'm recording right now lol. i will post soon.
English
testing tonight on dgx spark:
Qwen3.6-27B AEON Ultimate Uncensored DFlash on vLLM.
container: ghcr.io/aeon-7/vllm-ae… @SpaceTimeViking
DFlash SWA overlay + FlashInfer 0.6.11 cu130. curious how it behaves locally on GB10.
github.com/aeon-7/Qwen3.6…
English