Vivek Kumar

Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶 Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with @daitomanabe in Tokyo - and being featured as a top new music tool at NAMM 2026. We’re now fully open sourcing the plugin for developers to fork, modify, and make their own under the permissive Apache 2.0 license. 💾 Get it here: github.com/magenta/the-in…

Our short film Dear Upstairs Neighbors is previewing at @sundancefest. 🎬 It’s a story about noisy neighbors, but behind the scenes, it’s about solving a huge challenge in generative AI: control. Developed by Pixar alumni, an Academy Award winner, researchers, and engineers, here’s how it came together. 🎨

🔊New paper! Recomposer allows editing sound events within complex scenes based on textual descriptions and event roll representations. And we discuss the details that matter! Work led by Dan Ellis w/ a bunch of Sound Understanding folks @GoogleDeepMind arxiv.org/abs/2509.05256

🎬 The Video Arena Leaderboard is now live! 14,000+ community votes have ranked the top Text-to-Video and Image-to-Video models. 📝 Text-to-Video rankings: - #1 Veo3 (audio on) - #3 Veo3, Veo3-fast - #5 Hailuo 02 [Standard], Seedance 1.0 pro - #6 Kling 2.1 Master - #9 Wan 2.2 A14B - #11 Pika 2.2, Mochi 1 Big congrats to @GoogleDeepMind, @Hailuo_AI, Bytedance, @Kling_ai, @Alibaba_Wan, @pika_labs, and @genmoai!

🎬 The Video Arena Leaderboard is now live! 14,000+ community votes have ranked the top Text-to-Video and Image-to-Video models. 📝 Text-to-Video rankings: - #1 Veo3 (audio on) - #3 Veo3, Veo3-fast - #5 Hailuo 02 [Standard], Seedance 1.0 pro - #6 Kling 2.1 Master - #9 Wan 2.2 A14B - #11 Pika 2.2, Mochi 1 Big congrats to @GoogleDeepMind, @Hailuo_AI, Bytedance, @Kling_ai, @Alibaba_Wan, @pika_labs, and @genmoai!

Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/github/magenta… 👀 Blog post: g.co/magenta/rt 🧵 below

For years, we've been saying that bigger isn't always better for AI and that smaller specialized models are usually faster, cheaper and more accurate for your specific constraints. So super happy to release the long-overdue capability of finding the best model based on size on @huggingface! It took us a bit more time than expected to release because we needed to wait for safetensors & GGUF to become ubiquitous to do it easily but it's now live. Time for you to stop listening to AI influencers and find the best model (small or large) for you and your use-case!