Chuck Tang

75 posts

Chuck Tang

Chuck Tang

@j316chuck

building @trajectorylabs

San Francisco Katılım Kasım 2016
743 Takip Edilen389 Takipçiler
Chuck Tang retweetledi
Neil Movva
Neil Movva@neilmovva·
Samir Menon @blintzbase and I are thrilled to announce Sail @sailresearchco ! We build infrastructure for long-horizon agents: inference served at unbeatable prices-per-token for open models, plus sandboxes designed to run for days, weeks, or longer. We've raised $80M, w/ our seed led by @Sequoia and series A led by @KleinerPerkins. We're using this capital to build the most efficient infrastructure for long-horizon agents. What makes agents so different? Unlike a human waiting at a keyboard (top priority: speed), agents need scale, reliability, and sustainable cost. Sail finds this efficiency everywhere in the stack: we carefully choose our chips, write custom inference engines, and run a global controller that fully utilizes every computer in our fleet. Tight integration from silicon to API lets Sail open up the cost / latency frontier to our customers - the most patient agents can now access 10x more intelligence per dollar. We're excited to be working with great companies like @parallelweb, @detaildotdev,@Jackandjillai, and @quadrillion_ai to deploy long-horizon agents with trillions of tokens. Our team is thoughtful in our engineering craft and relentlessly ambitious in our pursuit of peak performance. We previously trained at companies like NVIDIA, OpenAI, Google, and so many trading firms. Now we're ready to do the work that will define our careers, in the most compute intensive market of all time. Welcome to the era of abundant intelligence. We can't wait to build with you!
Neil Movva tweet media
English
99
55
418
180.6K
Chuck Tang retweetledi
PatronusAI
PatronusAI@PatronusAI·
Today, we’re excited to announce our $50M Series B, led by @GreenfieldVC, with participation from @lightspeedvp and @notablecap. 🚀 At Patronus AI, we develop simulations and evals to train and improve AI. The first phase of AI was built on static benchmarks, but that era is over. As agents are used to solve longer and longer tasks, they need to practice in dynamic, living worlds to get better. Simulations are the critical infrastructure powering this next phase. As a company, we’re behind the most influential research and products in AI evaluation, like FinanceBench, Lynx, and Percival. And things have moved at the speed of light since.⚡ We partner with the world's leading frontier AI labs and enterprises, and our revenue has grown more than 15x over the past year. Additionally, today, we’re introducing a preview of the first Digital World Model for AI agent training and simulation: Patronus-DWM. Digital World Models are language diffusion world models that predict realistic environment behaviors and steer agent actions across digital workflows. Just as physical world models predict how objects move through space, we’re developing the equivalent for the digital world: predicting how agents act in digital workflows, then using that to scale the creation of high-quality training data for LLMs. Digital World Models help us push the frontier of ultra long horizon workflows, and unlock a new class of self-improving RL environments. This is our scalable approach to simulating all of the world’s intelligence. The round was also joined by @datadoghq, @SamsungVentures, @gokulr, @factorialcap, and a large cohort of amazing AI leaders across @AnthropicAI, @OpenAI, @GoogleDeepMind, @nvidia, @Recursive_SI, and more.✨ It has been the ride of a lifetime. But we’re just getting started. The best is yet to come. "Do not go gentle into that good night, Rage, rage against the dying of the light" - Dylan Thomas (1954)
English
33
24
128
93.9K
Trajectory
Trajectory@trajectorylabs·
1/ We post-trained @nvidia Nemotron 3 Ultra on @harvey Legal Agent Bench in under 24 hours. The result: an open model reaching the same band as leading closed models on legal work, at a fraction of the cost. The correlating story: when a new open model ships, Trajectory can turn it into a specialized agent almost immediately.
Trajectory tweet media
English
10
21
267
83.2K
Jane Zhang
Jane Zhang@jjanezhang·
Claude is always “excising” things from my writing. Where in the earth of training data did it uncover this word?
English
3
0
12
930
Trajectory
Trajectory@trajectorylabs·
5 Days of Trajectory 🏹Day 5: Scaling SDPO to Agentic Tasks Continual learning means you must train on data from production. But production gives you one example per task. A user makes a request once. You get one trajectory, not a batch. However, current RL algorithms don't work that way, They need groups of tasks. By definition, that means you need some artificial environment to perform those rollouts in. But what if you don't? SDPO is a promising route. It learns from a single trajectory, with no group required and failures still producing signal. The shape of the method matches the shape of production data. But one fundamental problem remained. Every published SDPO work assumed fresh, on-policy rollouts. Agentic work cannot give you that. Trajectories run for an hour or more and arrive stale. On true agentic tasks, naive SDPO collapses. We fixed it. We're the first to make SDPO work on agentic tasks. On Mercor's APEX-Agents, with hour-long trajectories and near-zero base pass rates: 25% average reward, 5x over zero-shot. More importantly, it trains stably and the curve is still climbing. Read more below.
Trajectory tweet media
English
9
11
131
41K
Chuck Tang
Chuck Tang@j316chuck·
@GoogleStartups @trajectorylabs Shoutout to the GCP team, Firestore and Kubernetes have been such incredible foundations to build on top off for our continual learning stack.
English
0
0
2
99
Chuck Tang retweetledi
Google for Startups
Google for Startups@GoogleStartups·
Big win for @Trajectorylabs! Continual learning just got a massive upgrade with C-LoRA—delivering 2.81x throughput for frontier models without sacrificing performance. Check out the open-source stack on SkyRL below!👇
Trajectory@trajectorylabs

🏹5 Days of Trajectory. Day 3 - An Open Source Training Stack for Continual Learning Building the platform for continual learning requires both partnering with pioneering AI companies, as we showed on Day 2 with Harvey, and working toward frontier research, which we are highlighting today. Continual learning means models that improve hourly from real production use. But with the size of frontier models, this becomes quite difficult. A Qwen-397b would need to spin up and tear down repeatedly across six GPU nodes, and that's valuable time gone. Our contribution is Continual LoRA (C-LoRA): many lightweight adapters running at once on one shared base model. Our insight centers on where the parallelism lives: instead of splitting one giant job across nodes, we load-balance many small jobs over a single base. The result: 2.81x experiment throughput over single-tenant training, with no regression on rewards. We built this together, with @anyscalecompute, @NovaSkyAI, and generous support from @GoogleCloud and @GoogleStartups. We've open-sourced on SkyRL as one of the first multi-LoRA, RL training platforms, so that every team can get to continual learning faster. We’re very excited to see what you build, please reach out!

English
4
4
32
7.4K
Trajectory
Trajectory@trajectorylabs·
🏹5 Days of Trajectory. Day 3 - An Open Source Training Stack for Continual Learning Building the platform for continual learning requires both partnering with pioneering AI companies, as we showed on Day 2 with Harvey, and working toward frontier research, which we are highlighting today. Continual learning means models that improve hourly from real production use. But with the size of frontier models, this becomes quite difficult. A Qwen-397b would need to spin up and tear down repeatedly across six GPU nodes, and that's valuable time gone. Our contribution is Continual LoRA (C-LoRA): many lightweight adapters running at once on one shared base model. Our insight centers on where the parallelism lives: instead of splitting one giant job across nodes, we load-balance many small jobs over a single base. The result: 2.81x experiment throughput over single-tenant training, with no regression on rewards. We built this together, with @anyscalecompute, @NovaSkyAI, and generous support from @GoogleCloud and @GoogleStartups. We've open-sourced on SkyRL as one of the first multi-LoRA, RL training platforms, so that every team can get to continual learning faster. We’re very excited to see what you build, please reach out!
Trajectory tweet media
English
11
62
507
95.9K
Sumanth Hegde
Sumanth Hegde@sumanthrh·
This is a special release. @j316chuck and team have been working closely with us in designing multi-LoRA training with SkyRL. @pcmoritz @tyler_griggs_ realized the value of the Tinker API a while back and led the Tinker server effort in SkyRL few months back. However we only had multi-tenancy with the Jax backend. We now have an initial implementation for multi-tenancy with Megatron+vLLM thanks to @j316chuck @erictang000. Props to @j316chuck for all the hard work on the benchmarks!
Chuck Tang@j316chuck

Had such a blast working with @erictang000 , @charlie_ruan, @sumanthhegde, and @pcmoritz on enabling multi-LoRA RL training in SkyRL! We observed ~3x higher experiments throughput in comparison to running experiments in the traditional single-tenant fashion. One of my favorite parts of this collaboration is that all this code is open source so you can play with it yourself :) Here's the technical deep dive 🧵

English
4
1
38
6.4K
Chuck Tang
Chuck Tang@j316chuck·
Had such a blast working with @erictang000 , @charlie_ruan, @sumanthhegde, and @pcmoritz on enabling multi-LoRA RL training in SkyRL! We observed ~3x higher experiments throughput in comparison to running experiments in the traditional single-tenant fashion. One of my favorite parts of this collaboration is that all this code is open source so you can play with it yourself :) Here's the technical deep dive 🧵
Trajectory@trajectorylabs

🏹5 Days of Trajectory. Day 3 - An Open Source Training Stack for Continual Learning Building the platform for continual learning requires both partnering with pioneering AI companies, as we showed on Day 2 with Harvey, and working toward frontier research, which we are highlighting today. Continual learning means models that improve hourly from real production use. But with the size of frontier models, this becomes quite difficult. A Qwen-397b would need to spin up and tear down repeatedly across six GPU nodes, and that's valuable time gone. Our contribution is Continual LoRA (C-LoRA): many lightweight adapters running at once on one shared base model. Our insight centers on where the parallelism lives: instead of splitting one giant job across nodes, we load-balance many small jobs over a single base. The result: 2.81x experiment throughput over single-tenant training, with no regression on rewards. We built this together, with @anyscalecompute, @NovaSkyAI, and generous support from @GoogleCloud and @GoogleStartups. We've open-sourced on SkyRL as one of the first multi-LoRA, RL training platforms, so that every team can get to continual learning faster. We’re very excited to see what you build, please reach out!

English
14
20
179
30.4K
Chuck Tang
Chuck Tang@j316chuck·
@erictang000 @charlie_ruan @sumanthhegde @pcmoritz 5/ Does quality still hold in multiLoRA-training? Yes Every run hit reward accuracy >90% by step 9 at every concurrency level, tracking the serial baseline within ±1σ across the final 4 steps. No regression.
Chuck Tang tweet media
English
0
1
8
241
Chuck Tang
Chuck Tang@j316chuck·
@erictang000 @charlie_ruan @sumanthhegde @pcmoritz 4/ As usual, there is no free lunch, the first multi-tenant experiment lands 1.97× slower than serial, trading off experiment throughput for latency. Our mean experiment time to completion is still much faster by 1.63×!
Chuck Tang tweet media
English
0
1
6
222
Chuck Tang
Chuck Tang@j316chuck·
@erictang000 @charlie_ruan @sumanthhegde @pcmoritz 3/ In practice, we tested on 8x GSM8K synchronous RL jobs recast as an agentic tool-learning task with Qwen3-4B as the base model. We saw 8 concurrent LoRAs outperform the serial baseline by 2.81x!
Chuck Tang tweet media
English
0
1
6
270
Chuck Tang
Chuck Tang@j316chuck·
@erictang000 @charlie_ruan @sumanthhegde @pcmoritz 2/ At Trajectory, we built a training platform served upon a warm engine with multi-LoRA training. The core idea: parallelize across jobs rather than within! We call this continual LoRA or (c-LoRA) for short.
Chuck Tang tweet media
English
0
1
7
262
Chuck Tang
Chuck Tang@j316chuck·
@erictang000 @charlie_ruan @sumanthhegde @pcmoritz 1/ There are 4 reasons RL training doesn't scale today - Cold starts: 30+ min per large job - Large models: Qwen3.5-397B takes 6 nodes for RL - Single-tenant: Only 1 experiment per set of GPUs - Low utilization: trainer and generator hard to optimize jointly
English
0
2
10
387