周.乙 (⌐▀͡ ̯ʖ▀)ノJoey
21.7K posts

周.乙 (⌐▀͡ ̯ʖ▀)ノJoey
@JoeyDeepWorld
待人以诚,示人以真。求实求是,不说假话。 剖析技术、制度与资本交织的世界结构,也审视人的命运。 🪐 预言家,🩳 皇帝新装撕裂者。 🤖 AI 🧠思考与传播。 📅 94年起写代码,💻 UNIX 和 C 打底。 深度长文:文章 / https://t.co/QaI6ZYPFoD








At 11k employees, our AI costs are going up. Which model & harness should we use to lower cost but also retain great quality? We didn't want to blindly trust public benchmarks. So we ran a comprehensive evaluation on our tasks, code base, infra. It's been produced by more than 3,000 software engineers, spans 3 hyperscalar clouds and many languages and tasks. The results are surprising. We find that for the SAME mdoel, the choice of harness can significantly save costs (~2x). We also find that GLM 5.2 performs extremely well. We run Omnigent in front of these and can easily multiplex different harnesses and models for different tasks. Check it out: databricks.com/blog/benchmark…
















