

Baseten
2.5K posts

@baseten
Inference is everything.



How to become an AI researcher with @oneill_c Charlie co-founded Parsed to build specialized open-source models that can outperform frontier labs. I first met Charlie when Parsed was acquired by Baseten, and now he leads our model development team. Charlie is one of the smartest people I know, and I had the pleasure of talking to him about: 0:00 Intro 3:13 Leaving Oxford to start a company 6:37 Becoming an AI researcher 15:37 Developing a unique POV as your moat 22:04 Parsed origin story 26:01 Big Token, the case for open-source models 33:40 Post-training, fine-tuning, specialization 46:52 Will open models catch up with closed models? 51:50 AI-led job replacement vs job creation 54:45 How to get into inference engineering This is one of my favorite conversations I’ve had in a long time. Made with @ad0rnai behind the scenes. Enjoy!

How to become an AI researcher with @oneill_c Charlie co-founded Parsed to build specialized open-source models that can outperform frontier labs. I first met Charlie when Parsed was acquired by Baseten, and now he leads our model development team. Charlie is one of the smartest people I know, and I had the pleasure of talking to him about: 0:00 Intro 3:13 Leaving Oxford to start a company 6:37 Becoming an AI researcher 15:37 Developing a unique POV as your moat 22:04 Parsed origin story 26:01 Big Token, the case for open-source models 33:40 Post-training, fine-tuning, specialization 46:52 Will open models catch up with closed models? 51:50 AI-led job replacement vs job creation 54:45 How to get into inference engineering This is one of my favorite conversations I’ve had in a long time. Made with @ad0rnai behind the scenes. Enjoy!



“Open-weight models ran 29% of gateway tokens, up from 11% in April”

We are hiring for @Harvey’s model training team. This team will help Harvey expand from the application layer into the model layer and from legal into high end knowledge work more broadly. We are hiring AI researchers of all seniority, particularly those with experience post-training frontier or open source models. Our program is centered around large-scale model training, synthetic data generation, long horizon reinforcement learning, and rigorous evaluation in real world deployments. We are scaling-pilled and believe that nothing beats the combination of larger models and better training data. We’ve been able to generate incredibly realistic legal environments and validated that this allows us to post-train open source models to achieve frontier performance with agents. We plan to scale up these data generation and training efforts significantly across legal to start, and eventually other verticals. As a researcher, you will have access to thousands of GPUs and unique training data from our product and customer relationships. Your research will inform Harvey’s product strategy and power AI used for some of the most economically and societally impactful work in the world.


Charlie is one of the smartest people I've met in SF. His thoughts on AI are extremely insightful. Can't recommend following him enough.

Some teaser results for a new quantization method we've been cooking up🧑🍳 GLM 5.2 is getting even faster




So @baseten runs billions of AI inference calls a day. And still hit a very human bottleneck: their first AE became the person with all the answers. Then answering became the job. So they built his digital double with Custom Agents. Questions that took Katz 30 minutes now take 20 seconds, around the clock. The whole company gets their answers. And Katz gets back to the deals only he can close.


