Yurong You

35 posts

Yurong You

Yurong You

@YurongYou

Katılım Mayıs 2018
62 Takip Edilen60 Takipçiler
Yurong You
Yurong You@YurongYou·
github.com/NVlabs/alpamay… Just released! Feel free to try it out!
Marco Pavone@drmapavone

Jensen today announced Alpamayo 1.5 at #NVIDIAGTC! #Alpamayo 1.5 is a major update to Alpamayo 1—@nvidia’s open 10B-parameter chain-of-thought reasoning VLA model, first introduced at #CES. Built on the #Cosmos-Reason2 VLM backbone and post-trained with RL, it adds support for navigation guidance, flexible multi-camera setups, configurable camera parameters, and user question answering. The result is an interactive, steerable reasoning engine for the AV community. We’re also releasing post-training scripts to help researchers and developers adapt the model. Additionally, we’ve significantly expanded the Alpamayo open platform across data and simulation, including releasing highly requested reasoning labels for the PhysicalAI Autonomous Vehicles dataset (huggingface.co/datasets/nvidi…), as well as our chain-of-causation auto-labeling pipeline. 🔎 Learn more about Alpamayo 1.5 and the latest extensions to the Alpamayo open platform: huggingface.co/blog/drmapavon… (please note that most of the links will become active in the next few days.) Happy building—and stay tuned for more in the coming months! @NVIDIADRIVE @NVIDIAAI

English
0
0
1
48
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
Jensen today announced Alpamayo 1.5 at #NVIDIAGTC! #Alpamayo 1.5 is a major update to Alpamayo 1—@nvidia’s open 10B-parameter chain-of-thought reasoning VLA model, first introduced at #CES. Built on the #Cosmos-Reason2 VLM backbone and post-trained with RL, it adds support for navigation guidance, flexible multi-camera setups, configurable camera parameters, and user question answering. The result is an interactive, steerable reasoning engine for the AV community. We’re also releasing post-training scripts to help researchers and developers adapt the model. Additionally, we’ve significantly expanded the Alpamayo open platform across data and simulation, including releasing highly requested reasoning labels for the PhysicalAI Autonomous Vehicles dataset (huggingface.co/datasets/nvidi…), as well as our chain-of-causation auto-labeling pipeline. 🔎 Learn more about Alpamayo 1.5 and the latest extensions to the Alpamayo open platform: huggingface.co/blog/drmapavon… (please note that most of the links will become active in the next few days.) Happy building—and stay tuned for more in the coming months! @NVIDIADRIVE @NVIDIAAI
English
7
30
155
16.7K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
What does it take to build autonomous vehicles that can reason about the world they drive in? Tomorrow at #NVIDIAGTC, Patrick Liu and I will take a deep dive into the #Alpamayo #reasoning model family—a family of reasoning-based vision–language–action (#VLA) models that form a core component of the Alpamayo open platform (huggingface.co/blog/drmapavon…). We’ll cover three main topics: - How reasoning-based VLA models like Alpamayo 1 are designed and built - What it takes to bring Alpamayo 1 to production, including some of our latest results - Several exciting announcements about the expansion of the Alpamayo open platform If you're working on autonomous driving, robotics, or foundation models for physical AI, this session will offer a look at where the field is heading. Session details: 📅 Monday, Mar 16 | 3:00 PM PDT 📍 #NVIDIAGTC 2026 🔗 nvda.ws/4rze5oj Looking forward to seeing many of you there. @NVIDIADRIVE @NVIDIAAI
English
0
18
72
7.1K
Yurong You retweetledi
Maximilian Igl
Maximilian Igl@MaxiIgl·
Simulation is essential for scaling the development of autonomous vehicles - from synthetic data generation to evaluation up to closed-loop training/reinforcement learning! We're organizing the Third Workshop on "Simulation for Autonomous Driving" (SAD) at #CVPR2026 in Denver, CO, USA, to bring together leading experts advancing simulation fidelity and simulation-based training. This half-day workshop features exciting keynotes from top researchers in the field, contributed papers, and a panel discussion - covering behavior modeling, sensor simulation, world models, reinforcement learning, and more. Invited Speakers: @drmapavone (Stanford / NVIDIA), @AnguelovDrago (Waymo), @francislee2020 (University of Hong Kong), Siva Manivasagam (Waabi), @wucathy (MIT). A big thank you to all speakers and organizers! Organizers: @yiyi_liao_, @MaxiIgl , Kashyap Chitta, @AzadehDinparast, Maximilian Naumann, @ZGojcic, @stan188249301, Kate Tolstaya, @wangjksjtu, @FidlerSanja, @shimon8282. 📝 Call for Papers is opening soon! Submission deadline: March 12, 2026. 🔗 agents4ad.github.io
English
0
7
10
1.2K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
🚀 Exciting news from #CES2026! In his keynote today, Jensen announced @nvidia Alpamayo — a *fully open* ecosystem of models, simulation tools, and datasets designed to accelerate reasoning-based autonomous vehicle (AV) architectures and advance the path to Level 4 autonomous driving. Alpamayo brings together several technologies we’ve developed to enable reasoning-based vision–language–action (VLA) models for AVs. Our goal is to provide researchers and developers with a flexible, fast, and scalable platform for evaluating and training reasoning-based AV architectures in realistic closed-loop settings. Explore Alpamayo: -- Press Release: nvidianews.nvidia.com/news/alpamayo-… -- Hugging Face Blog: huggingface.co/blog/drmapavon… -- Tech Blog: developer.nvidia.com/blog/building-… -- Alpamayo 1 reasoning model: research.nvidia.com/publication/20… -- Physical AI AV Dataset: huggingface.co/datasets/nvidi… -- AlpaSim simulator: github.com/NVlabs/alpasim I’m incredibly proud of the @nvidia AV Research team (research.nvidia.com/labs/avg/) and our many @nvidia collaborators whose contributions made this possible. More releases and features are coming soon — we can’t wait to see what the community builds with Alpamayo! 💡 Want to help grow the Alpamayo ecosystem? We’re hiring: [Sr.] Research Scientist: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx… [Sr.] Research Engineer: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx… #AutonomousVehicles #AutonomousDriving #AI #Simulation #ReasoningAI #OpenEcosystem #Alpamayo @NVIDIAAI @NVIDIADRIVE
Marco Pavone tweet media
English
4
9
65
114K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
🚗 Imitation learning is everywhere—but is it enough? So far, imitation learning—most commonly via behavior cloning (BC)—remains the go-to approach for training real-world autonomous vehicle (AV) driving policies. Yet BC operates in an open-loop (OL) fashion, overlooking the critical interdependence among inputs, outputs, and future states that comes with closed-loop (CL) operation. The result? The notorious—but often overlooked—OL–CL gap ⚠️ To address this challenge and encourage broader adoption of CL techniques, we’ve just published a survey (research.nvidia.com/publication/20…) presenting a comprehensive taxonomy of closed-loop training methods for end-to-end driving. Our framework organizes approaches along three key axes: - Action generation - Environment response generation - Training objectives 💡 Bottom line: enabling technologies—like neural rendering, generative world models, and scalable RL—have now matured, making closed-loop AV training ready for wide-scale adoption. We’d love to hear your thoughts—drop a comment and join the discussion! 💬 And as a reminder, we are hiring for full-time research scientist and research engineer positions: 🔹 [Sr.] Research Scientist: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx… 🔹 [Sr.] Research Engineer: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx… @NVIDIADRIVE @NVIDIAAI @nvidia
English
1
16
96
9.2K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
We’ve just released @nvidia #DRIVE Alpamayo-R1 (AR1) — the world’s first industry-scale open #reasoning #VLA model for autonomous-vehicle (AV) research. AR1 integrates Chain-of-Causation reasoning with trajectory planning to improve decision-making in complex driving scenarios. Built on @nvidia #Cosmos #Reason, AR1 is designed as a customizable foundation for a broad range of AV applications — from instantiating an end-to-end backbone for autonomous driving to powering advanced, reasoning-based auto-labeling tools. Resources: Model: huggingface.co/nvidia/Alpamay… Inference Code: github.com/NVlabs/alpamayo Paper: research.nvidia.com/publication/20… Blog Post: blogs.nvidia.com/blog/neurips-o… A subset of the data used to train and evaluate AR1 is available in the @nvidia Physical AI Open Datasets: huggingface.co/datasets/nvidi… AR1 can be evaluated using AlpaSim (github.com/NVlabs/alpasim), @nvidia's newly released open-source AV simulation framework built specifically for research and development. (Separate post on AlpaSim coming soon.) This release completes @nvidia’s trifecta — model, data, and simulator — to accelerate research and development in the autonomous-vehicle domain. Happy developing, and stay tuned for more! Huge thanks to the phenomenal team that made this possible @NVIDIAAI @nvidia.
English
4
29
173
22.4K
Yurong You
Yurong You@YurongYou·
So excited to see Alpamayo-R1 finally out! Working on this project felt like watching a baby grow up — and it’s still evolving fast :)
Marco Pavone@drmapavone

Excited to unveil @nvidia's latest work on #Reasoning Vision–Language–Action (#VLA) models — Alpamayo-R1! Alpamayo-R1 is a new #reasoning VLA architecture featuring a diffusion-based action expert built on top of the #Cosmos-#Reason backbone. It represents one of the core technologies driving NVIDIA’s push toward Level 4 autonomy and robotaxis (nvidianews.nvidia.com/news/nvidia-ub…), as announced by Jensen Huang at #gtc DC last week. 📄 Paper: Alpamayo-R1 research.nvidia.com/publication/20… We present: - Architecture & Design: How to transform a VLM into a driving-ready Reasoning VLA - Chain of Causation Labeling: A new framework enabling reasoning-based learning - Training Strategy: From internet-scale pre-training → AV-specific SFT → RL-based post-training - Extensive Evaluation: From closed-loop simulation to real-world, on-vehicle testing 📈 Results: Alpamayo-R1 delivers significant performance gains over end-to-end baselines — especially in rare, safety-critical scenarios — all while maintaining real-time inference (99 ms end-to-end latency). Coming soon: releases of model variants and reasoning metadata built on top of the Physical AI Dataset (huggingface.co/datasets/nvidi…)—with more updates on the way. Stay tuned! 🙌 Huge thanks to Wenjie Luo and @yan_wang_9 (project co-leads); the @nvidia AV Research team (@iamborisi, @YurongYou, @xinshuoweng, @tianran_, @wenhaoding95, and many others); collaborators across @nvidia Research (@liu_mingyu, @visualyang, @PavloMolchanov, and many others); and the @nvidia AV Product team (Sarah Tariq, Patrick Liu, Jack Huang, and many more). Full contributor list in the Appendix. @NVIDIADRIVE @NVIDIAAI

English
0
0
4
552
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
Simulation is one of the fastest-growing technologies in Physical AI. It’s now widely used for both testing and training—but can it also be applied to safety validation, where accurate estimates of safety metrics are critical? Join me and my @NVIDIAAI colleagues, @apoorva__sharma and Rachel Luo, for a live session where we will be discussing how to accelerate AV safety validation through simulation. 📅 Wednesday, Oct 22 | 9–10 AM PDT 🔔 Add to calendar: nvda.ws/3KHf99n
Marco Pavone tweet media
English
0
6
17
2.6K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
The Autonomous Vehicle (AV) Research Group @NVIDIAAI is looking for talented interns! Dive into cutting-edge work—from reasoning models and generative simulation to AI safety—and help shape the future of AV and embodied AI. Ready to push the limits? Apply now: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx…
English
2
14
62
9K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
We’re now accepting applications for the 2026–2027 NVIDIA Graduate Fellowships! If you’re passionate about advancing cutting-edge reasoning models for Physical AI applications 🚗🤖, apply here: research.nvidia.com/graduate-fello… — and be sure to select “Autonomous Vehicles.” @NVIDIAAI
English
1
26
105
12.3K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
Can we use simulation to validate Physical AI? Yes—with far fewer real-world tests. We propose a control variates–based estimation framework that pairs sim & real data to dramatically cut validation costs. #AI #Robotics #Sim2Real" Paper: arxiv.org/pdf/2506.20553 @NVIDIADRIVE
English
1
13
37
5.7K
Yurong You retweetledi
Boris Ivanovic
Boris Ivanovic@iamborisi·
Happy to share our latest work on efficient sensor tokenization for end-to-end driving architectures! arxiv.org/abs/2506.12251 We introduce a novel way to tokenize multi-camera input for AV Transformers that is resolution- and camera-count-agnostic, yet geometry-aware 🧵👇
English
2
13
31
3.9K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
At #GTC2025, Jensen unveiled Halos, a comprehensive safety system for AVs and Physical AI. Halos integrates numerous technologies developed by my team @nvidia, and I was thrilled to help coordinate its launch alongside Riccardo Mariani and many amazing colleagues @NVIDIADRIVE.
English
1
11
30
4.1K
Yurong You retweetledi
Boris Ivanovic
Boris Ivanovic@iamborisi·
Don’t miss this deep dive into the future of autonomous vehicles! Excited to present about how foundation models are transforming AV technology with @ALVAREZ_JOSEM at #GTC25! Check out all the session details below 👇
NVIDIA DRIVE@NVIDIADRIVE

💡 Learn about leveraging foundation models such as vision-language models and video generation models for #autonomousvehicle development in this new #GTC25 session on Mar. 19, 4pm: Research to Production: Transforming AV Technology With AI [S72707] ➡️ nvda.ws/4kDXr49

English
0
8
7
3K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
For the first time ever, @nvidia is hosting an AV Safety Day at GTC - a multi-session workshop on AV safety. We will share our latest work on safe AV platforms, run-time monitoring, safety data flywheels, and more! #AutonomousVehicles #AI at #GTC25 ➡️ nvda.ws/3Xc3xPo
English
0
13
32
4.4K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
AI4I, the Italian Institute of Artificial Intelligence for Industry (ai4i.it), has launched an international call for Heads of R&D Units (ai4i.it/call-for-head-…). This is a unique opportunity to shape the AI roadmap in Italy and beyond! @FabioPammolli
English
1
4
13
2K
Yurong You retweetledi
Marco Pavone
Marco Pavone@drmapavone·
Introducing DreamDrive, which combines the complementary strengths of generative AI (video diffusion) and neural reconstruction (Gaussian splatting) to transform any street-view image into a dynamic 4D driving scene! Web: pointscoder.github.io/DreamDrive/ Paper: arxiv.org/abs/2501.00601
Marco Pavone tweet media
English
4
42
217
21.7K