Russell Mendonca

165 posts

Russell Mendonca

Russell Mendonca

@mendonca_rl

World models for robotics @GoogleDeepMind Prev - Optimus AI @Tesla, PhD student @CMU_Robotics

เข้าร่วม Şubat 2020
261 กำลังติดตาม3.6K ผู้ติดตาม
ทวีตที่ปักหมุด
Russell Mendonca
Russell Mendonca@mendonca_rl·
Amazing capabilities at low latency. Personal news: I’ve joined DeepMind to push on world models! Large-scale video pre-training will unlock generalist robots. Proud of helping drive transfer from human video at Tesla. The team's on a great trajectory for humanoid products.
Jeff Dean@JeffDean

One of the things we strive to do with each new Gemini release is to make the new Flash model as good or better than the previous model’s Pro model. Gemini 3 Flash exceeds Gemini 2.5 Pro on nearly every metric, often by very large margins, and almost matches Gemini 3 Pro on most benchmarks.

English
7
0
152
18.1K
Russell Mendonca รีทวีตแล้ว
Demis Hassabis
Demis Hassabis@demishassabis·
We’re making great progress with our Gemini Robotics work in bringing AI to the physical world - a critical aspect of AGI. As part of our next steps, super excited to announce our partnership with @BostonDynamics, combining our SOTA robotics models with their world-class hardware
Google DeepMind@GoogleDeepMind

Google DeepMind 🤝 @BostonDynamics Our new research partnership will bring together our advancements in Gemini Robotics’s foundational capabilities to their new Atlas® humanoids. 🦾 Find out more → goo.gle/49paguA

English
200
450
4.5K
322.4K
Russell Mendonca รีทวีตแล้ว
Jeff Dean
Jeff Dean@JeffDean·
Excited to pair our @GoogleDeepMind robotics efforts, where we've been working on robotic learning for many years (including variants of our Gemini models especially suited for visual understanding and robotic action) with the very capable robotics hardware from @BostonDynamics.
Google DeepMind@GoogleDeepMind

Google DeepMind 🤝 @BostonDynamics Our new research partnership will bring together our advancements in Gemini Robotics’s foundational capabilities to their new Atlas® humanoids. 🦾 Find out more → goo.gle/49paguA

English
43
74
969
79.2K
Russell Mendonca
Russell Mendonca@mendonca_rl·
Impressive that the base model can be adapted for these dexterous tasks, particularly the lock and key. Note that training from scratch doesn’t work. Pre-training is critical for generalist robots, just as it is for generalist language / image / video models.
Physical Intelligence@physical_int

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!

English
0
0
19
3K
Russell Mendonca
Russell Mendonca@mendonca_rl·
@SuvanshSanjeev Appreciate the kind words, Suvansh! I'm very bullish on the future of robotics, optimistic that the same ML trends in language, audio, and video will extend here too.
English
1
0
5
307
Suvansh Sanjeev
Suvansh Sanjeev@SuvanshSanjeev·
russ led the most exciting robotics breakthrough this year while at tesla — learning from egocentric human video enables scaling human data without instantiating robots. will be one of the two main stories in robotics thoughtful, outlier humility, elite researcher. huge for goog
Russell Mendonca@mendonca_rl

Amazing capabilities at low latency. Personal news: I’ve joined DeepMind to push on world models! Large-scale video pre-training will unlock generalist robots. Proud of helping drive transfer from human video at Tesla. The team's on a great trajectory for humanoid products.

English
2
1
7
1.4K
Russell Mendonca รีทวีตแล้ว
Wes Roth
Wes Roth@WesRoth·
Demis Hassabis believes world models are essential because they simulate the physical dynamics of reality, things language alone can’t fully express. Language models learn from words, but many real-world experiences like motion, smell, or sensorimotor feedback can’t be captured in text. Simulations help systems understand intuitive physics, spatial reasoning, and cause-effect dynamics. This is key for robotics, wearables, and AI that can navigate and assist in the real world.
English
7
14
55
4.2K
Russell Mendonca
Russell Mendonca@mendonca_rl·
Sensorized human collection is the most promising path for data scaling to enable generalist robots. Interesting insights on critical mass of robot diversity needed for the model to start using human data!
Physical Intelligence@physical_int

We discovered an emergent property of VLAs like π0/π0.5/π0.6: as we scale up pre-training, the model learns to align human videos and robot data! This gives us a simple way to leverage human videos. Once π0.5 knows how to control robots, it can naturally learn from human video.

English
1
1
34
3.2K
Russell Mendonca รีทวีตแล้ว
Tesla Optimus
Tesla Optimus@Tesla_Optimus·
Just set a new PR in the lab
English
2.1K
3.5K
24.5K
38.6M
Russell Mendonca
Russell Mendonca@mendonca_rl·
More compelling evidence that data from sensorized humans (with gloves) can match / exceed teleop for quality of learned behaviors. And of course it’s a much more scalable data source. Congrats @tonyzzhao and team!!
Tony Zhao@tonyzzhao

Today, we present a step-change in robotic AI @sundayrobotics. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

English
3
2
43
4.4K
Russell Mendonca
Russell Mendonca@mendonca_rl·
Precise, dexterous, long-horizon control for 13 continuous hours, truly amazing result! Also full circle moment for @smithlaura1028, she developed a coffee robot prototype years ago at Berkeley with a very prescient approach, complete with real world practice.
Laura Smith@smithlaura1028

Excited to share what we've been brewing at PI! We’re working on making robots more helpful by making them faster and more reliable through real-world practice, even on delicate behaviors like carrying this very full latte cup

English
2
2
43
4.9K
Kevin Zakka
Kevin Zakka@kevin_zakka·
Super happy and honored to be a 2025 Google PhD Fellow! Thank you @Googleorg for believing in my research. I'm looking forward to making humanoid robots more capable and trustworthy partners 🤗
Google.org@Googleorg

🎉 We're excited to announce the 2025 Google PhD Fellows! @GoogleOrg is providing over $10 million to support 255 PhD students across 35 countries, fostering the next generation of research talent to strengthen the global scientific landscape. Read more: goo.gle/43wJWw8

English
35
4
193
22.9K
Russell Mendonca รีทวีตแล้ว