Beam

@cmellor 🙏

@beam_cloud is so good! If you want to try using or deploying open-source models, give them a shot—the DX is fantastic.

Day 2 of building a YouTube thumbnail maker app. My friend and I found a newly released open-source image model, self-hosted it, and reduced costs 2x per thumbnail. Let's fcking go!

Beam (@beam_cloud) is an open source serverless platform for AI apps. Run GPU inference, background jobs, and sandboxes with ultrafast boot times and no vendor lock-in. ycombinator.com/launches/OuS-b…

Beam Sandboxes fully support Docker and Docker Compose 🚢 Sandboxes are containerized cloud environments for running user code, reinforcement learning experiments, and evaluating LLMs. We launched Sandboxes earlier this year, and we kept getting the same question from developers: Do you support running Docker inside the Sandboxes? Even though we’ve always supported Docker images, running the Docker daemon inside sandboxes required modifying our container runtime. To ship this securely, we added gVisor support to Beam. This unlocks a few things: > Run Docker and Docker Compose in isolated cloud environments > Multi-tenant security without exposing the host Docker daemon > Fully reproducible environments (if it works locally, it works on Beam) If you're building something that needs secure, isolated Docker environments, give this a shot!

Speed of iteration is the single biggest factor to developer productivity. That’s why, 4 years ago, we decided to build Beam. Earlier this year, we partnered with solitude.ai. They needed a way to serve a document extraction API to customers. And they chose Beam — not because it was cheap, not because it looked cool, not because it was some fancy new AI platform. The founder, Adrian, is a technical guy. He knows Kubernetes, he can set up an autoscaler, and he knows how to package ML models using Docker and FastAPI. But he didn’t want to spend time thinking about that stuff. Since using Beam, they've closed several huge customers and 10x’d their document processing pipeline. We’re thrilled to partner with them on their journey.

@superagent_ai 🖖🔥🖖🎉

The first week after we released the initial version of VibeKit we got a lot of request about enabling @beam_cloud Sandboxes. Super excited about this collaboration: x.com/beam_cloud/sta…

Introducing @vibekit_sh + Beam 🎉 VibeKit is the safety layer for running Claude Code, Gemini, and other coding agents. You can now run Claude Code, Gemini, and other coding agents in secure cloud sandboxes with: - Snapshotting and forking - Custom Docker images - Ultrafast boot times - GPU support - No timeouts Get started --> `npm install @vibe-kit/beam`

@mernit 😍

We're very excited to share our official TypeScript SDK for Sandboxes. As you know, @beam_cloud is traditionally a Python-focused shop. Not anymore! Now you can use Sandboxes without touching a line of Python. First, let's recap: Beam Sandboxes are secure environments for running AI-generated code on the cloud. You can use Sandboxes to make your own AI-app builders, create RL environments, and run evals. The TypeScript SDK lets you spin up these environments in code, without Kubernetes or YAML. Please enjoy!

Excited to announce the new Client class in the Beam SDK This SDK update makes it easier to programmatically interact with your Beam apps. You can: - Retrieve tasks and deployments by ID - Submit file inputs to your endpoints, without writing boilerplate code - Retrieve task IDs immediately after running task_queue.put() - Make your functions wait for task results Check out the docs here: #client" target="_blank" rel="nofollow noopener">docs.beam.cloud/v2/reference/s…

80% faster cold starts with one click Just added a new checkpointing feature in your Beam dashboard: - Go to any deployment - Toggle "checkpoint enabled" - Watch cold starts drop up to 80% Works on models you've already deployed, no code changes needed. That's it. Your users get ultrafast responses instead of waiting 30 seconds for your model to load into memory. Live now in your dashboard.

Announcing 🔒 Spending Limits Set a spending limit on Beam in 2 clicks: 1. Dashboard → Settings → Workspace Budget 2. Enter your monthly budget We'll automatically pause your containers when you hit your limit. It's live now and takes 30 seconds to set up.

Check out the docs: docs.beam.cloud/v2/sandbox/sna…

Just launched Memory Snapshots for Sandboxes 📷 Memory snapshots let you freeze any Sandbox state: - Run sandbox.snapshot_memory() on your running Sandbox - Capture memory state as immutable artifact - You can spin up identical environments instantly from that snapshot It's perfect for testing code variations without losing your current state. Or skipping 5 minutes of setup every time you create a new session.

literally 14 lines of python wild

Most RAG apps fail due to retrieval. Today, we'll build a RAG system that self-corrects inaccurate retrievals using: - @firecrawl for scraping - @milvusio as vectorDB - @beam_cloud for deployment - @Cometml Opik for observability - @Llama_Index for orchestration Let's go!

Granary just dropped: ⏱️1M hrs 🌎 25 EU languages Load the dataset onto a Beam volume and fine-tune Canary-1b-v2 or Parakeet-tdt-0.6b tonight 🔥

Prototyping on GPUs sucks. You spend hours spinning up instances, waiting for images to build, deploying APIs, then tearing it all down. We've used AWS, GCP, and Lambda Labs. None made it easy to quickly run code on a GPU. Here's what finally fixed it.

Really love what they are building at @beam_cloud. Cold boots are 80% faster!

We will be speaking at the @aiusergroup meetup in San Francisco next week! When: Wednesday, August 20, 6pm Agenda: ​6:30pm: Google Cloud Run for AI (Inference, agents, and MCP) by @steren ​7pm: A Python-First Approach to AI Infra, from Sandboxes to Inference by @mernit ​7:30pm: Zylo-docs: The Code-first, AI-powered API Spec Tool  by Nick Park 🙌 RSVP --> lu.ma/qemn7akv