PSA: DGX Spark + Laguna S 2.1 NVFP4+DFlash is ~15–23 tok/s freeform. No it is not 77 tok/s. No it is not 50 tok/s everyday chat. No it is not a very fast model to run on the DGX Spark. Is it an amazing model? Remains to be seen. Am I also very excited that open weights keep landing next to frontier models? Absolutely. We can all feel excited. We should also be honest and not farm for clicks. If someone’s posting 5× that as “single session decode,” make them define the benchmark.

@gitcommit90 Our testing has us at 35-40 tok/s. Would be interesting to see what you’re using here and context length.

15–23 was freeform streaming decode, thinking off, short ctx (not even a filled 256k run). GB10, vLLM 0.25.1, official-ish NVFP4+DFlash path, max-model-len 262144. client stream timings, not UI gen tok/s. code prompts landed ~40–44 — so 35–40 tracks if you’re not pure freeform. what’s your prompt + metric?

@gitcommit90 @joerowell you’re our resident spark inference expert. I’m always testing with coding agents, so I do hit quite a bit of cache.