"When it comes to GPU, we're using Runpod." We recently interviewed the team from @ToolofNA, the studio behind AI campaigns for AT&T, AMD, Coca-Cola & Miro.
They kept the big clouds for the rest. GPU work moved to Runpod: 50–60% lower cost, setup from days to hours.
Read the full case study: runpod.io/case-studies/h…
You trained on an A100, so you served on the same A100.
Makes sense until it's idling at 3% between requests and billing you the whole time. Training and inference just want different machines.
If you're shipping, here's a helpful breakdown: runpod.io/articles/guide…
Your agent works great in dev. Then production hits and your costs look like a heart monitor.
Turns out there are five distinct agentic workflow patterns, and each puts a different shape of demand on your infrastructure.
We broke them all down here: runpod.io/blog/agentic-a…
Spending way too much on inference? Before you blame the model, check your architecture.
We mapped out what this looks like in practice: runpod.io/blog/engineeri…
"Which inference engine should we use, vLLM or TensorRT-LLM?"
We see this question a lot.
If you're mid-decision, the full breakdown is here, including where each one tends to surprise people:
runpod.io/articles/compa…
Deploy When Available is now GA. Queue for any GPU spec, even if it's fully rented out, and we'll deploy your pod the moment it frees up.
Here's how to get started → runpod.io/blog/deploy-wh…
Flash Hack Day is in the books. 11 teams hacked and demoed live, with real production endpoints, shipped in a day.
Congrats to Phong Cao (FlashML), Nelson Lai (FlashDock), and Sulaxmi Raskar (LifeLine).
First one, not the last.
You can find all projects here: #projects" target="_blank" rel="nofollow noopener">hackersquad.io/events/runpod-…
We'll be at the AI Engineer World's Fair this week, June 29 – July 2 in San Francisco.
If you're attending, come find us! We always love to chat about what you're building.
See you there.
Two days until Flash Hack Day. We've got credits and cash prizes for the top projects, plus a gift for every single person who builds with us.
The event is remote-friendly. So if you can't join us in San Francisco, just join us online!
Register through the link below:
luma.com/runpod-flash-j…
Today, we’re excited to announce our $50M Series B, led by @GreenfieldVC, with participation from @lightspeedvp and @notablecap. 🚀
At Patronus AI, we develop simulations and evals to train and improve AI. The first phase of AI was built on static benchmarks, but that era is over. As agents are used to solve longer and longer tasks, they need to practice in dynamic, living worlds to get better. Simulations are the critical infrastructure powering this next phase.
As a company, we’re behind the most influential research and products in AI evaluation, like FinanceBench, Lynx, and Percival. And things have moved at the speed of light since.⚡ We partner with the world's leading frontier AI labs and enterprises, and our revenue has grown more than 15x over the past year.
Additionally, today, we’re introducing a preview of the first Digital World Model for AI agent training and simulation: Patronus-DWM.
Digital World Models are language diffusion world models that predict realistic environment behaviors and steer agent actions across digital workflows. Just as physical world models predict how objects move through space, we’re developing the equivalent for the digital world: predicting how agents act in digital workflows, then using that to scale the creation of high-quality training data for LLMs.
Digital World Models help us push the frontier of ultra long horizon workflows, and unlock a new class of self-improving RL environments. This is our scalable approach to simulating all of the world’s intelligence.
The round was also joined by @datadoghq, @SamsungVentures, @gokulr, @factorialcap, and a large cohort of amazing AI leaders across @AnthropicAI, @OpenAI, @GoogleDeepMind, @nvidia, @Recursive_SI, and more.✨
It has been the ride of a lifetime. But we’re just getting started. The best is yet to come.
"Do not go gentle into that good night,
Rage, rage against the dying of the light"
- Dylan Thomas (1954)
Join us June 25 for a live demo of what's new in Runpod Serverless — hot starts, batch inference, and a cold-to-running deployment on stage.
Register here: resources.runpod.io/whats-new-in-r…
We just closed a $100M Series A led by @SummitPartners. 🎉
1M+ developers. $22M raised to get here. Almost entirely word of mouth.
Pods. Serverless. Clusters. The full AI lifecycle on one platform. We're moving faster on all of it.
runpod.io/blog/one-milli…
We had a great time at the @databricks Data+AI Summit this week.
Always great to see so many builders who are shipping real AI workloads.
Thanks to everyone who stopped by the booth, and we'll see you at the next one!
What happens before the first request hits your serverless endpoint?
Join us on June 25 when Greg Wester shows you a live deployment of FlashBoot & batch inference.
Register here: resources.runpod.io/whats-new-in-r…