Haoran Geng

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: roboverseorg.github.io/ViTacFormerPag… Paper link: arxiv.org/abs/2506.15953 Github: github.com/RoboVerseOrg/V…

Humanoid robots shouldn't just follow pre-defined movements—they should perform! 🤖✨ Introducing UniAct: A unified model for multimodal motion generation and action streaming. Most humanoids are limited to pre-designed moves. UniAct changes the game by allowing robots to generate live action sequences from: 📝 Text instructions 🎶 Music rhythms 📉 Spatial trajectories 🔄 Cross-modal signals Whether it’s dancing to a beat or following a complex path, UniAct brings humanoid robots to life in real-time. 🚀 🔗 Project: jnnan.github.io/uniact 📄 Paper: arxiv.org/abs/2512.24321

Excited to see what @SharpaRobotics has achieved recently. Proud that we shaped the ViTacFormer prototype—even before the hand was fully product-ready, we were already making a hamburger (and doing many other tasks). My takeaway: how you fuse vision + touch matters a lot. With clean, high-quality teleop data, you can get impressive generalization with even ~50 demos.

Large Video Planner Enables Generalizable Robot Control

@karanjagtiani04 Human data is actually much more scalable than robot data. Large part of our training data are in the wild human data, which i believe is quite scalable.

@HaoranGeng2 Impressive use of video data for robot planning. Curious about scalability-how do you handle potential data bottlenecks?

This might be my "aha moment" of 2025: With our new robotics foundation model, Large Video Planner, we train a robot planner from large-scale video data. It works so well that we can use it directly for robot planning. Two moments really blew my mind: First: right after our model training, I fed in an image of my hand and my MacBook and asked it to close the laptop—when the Apple logo appeared exactly as the lid came down, I couldn’t help but feel impressed (and excited). Second demo: picking up the brush — check the 3D consistency. Even the brush shadow is remarkably accurate, and it can even infer what the Franka arm (at the corner) should look like.

@bruk_phi We actually use a lot of human dataset, large part of the training dataset are human data, and we also use human hand as an intermediate representation for robot planning.

@HaoranGeng2 what would be the advantage over using human datasets instead

Also check more intro here: x.com/BoyuanChen0/st… Do try our model and check more information here: boyuan.space/large-video-pl…

Because of the model’s remarkably accurate 3D consistency and human-hand prediction, we can use it directly for robotics planning—and it already pulls off a bunch of amazing dexterous tasks: zero-shot and, in some cases, first-ever. It also makes me believe even more that human-centric, in-the-wild data has huge potential to further boost robotics pretraining.

Been working on this for a long time—Large Video Planner is finally out. We found that large-scale video pretraining can actually teach models surprisingly accurate physics. With strong camera consistency and realistic hand shaping, we can use the model directly for robotics planning. When I tried using our dexterous hand to pull off extremely challenging zero-shot tasks—often for the first time—made it clear just how capable this model is.

🏆 Announcing #IROS RoboGen Best Open Source Award: RoboVerse @FeishiWang @siyuanhuang95 @yuewang314

@carlo_sferrazza @UTAustin @utmechengr @texas_robotics Congrats Carlo!!!🔥

Excited to share that I'll be joining @UTAustin in Fall 2026 as an Assistant Professor with @utmechengr @texas_robotics! I'm looking for PhD students interested in humanoids, dexterous manipulation, tactile sensing, and robot learning in general -- consider applying this cycle!

Huge thanks to all the contributors and the great RoboVerse team: github.com/RoboVerseOrg/R… All our code is open-source at github.com/RoboVerseOrg/R…

🎉🎉🎉 We won the champion in the solo dance contest at the first World Humanoid Robot Games, partner with @UnitreeRobotics ! Here is the full video! Training the robot to perform a long-term dancing (2:30 mins) with stability, smoothness, and agility is much more challenging than we expected. The robot needs to dance with the rhythm, keep global position, move dynamically and cannot fall. You cannot cherry pick on the playing field. More technical details will be released in the future.

@QianqianWang5 Congrats!!!

📢Thrilled to share that I'll be joining Harvard and the Kempner Institute as an Assistant Professor starting Fall 2026! I'll be recruiting students this year for the Fall 2026 admissions cycle. Hope you apply!

Introducing ViTacFormer: Next-Level Dexterous Manipulation with Active Vision and High-Resolution Touch by @HaoranGeng2 #AI #Robotics #MachineLearning #ArtificialIntelligence #ML #Innovation cc: @sallyeaves @amuellerml @marcusborba

@adcock_brett FYI, check out our original post here: x.com/HaoranGeng2/st…

Thank you so much, @adcock_brett, for featuring our new work, ViTacFormer! Generalizable and robust manipulation remains a long-standing and challenging goal in robot learning—we’re excited to keep pushing the boundaries. More exciting things are on the way—stay tuned! 🚀

Again the power of tactile sensing and multi-finger hands comes through. This is the future of dexterous manipulation!

There is a raging debate over sensory modes and redundancy How much is enough and is sensory overload an issue Perhaps the key is redundant modes are the fabric that hold actions together to solve long term planning Think fascia

This work wouldn’t have been possible without the incredible support from great collaborators @cosm_para13983 and @KaifengZhang4, and my amazing advisors @JitendraMalikCV and @pabbeel. Thank you all! 🙏 Code is fully released; check out our: Homepage: roboverseorg.github.io/ViTacFormerPag… Paper link: arxiv.org/abs/2506.15953 Github: github.com/RoboVerseOrg/V…

We then explored the full capabilities of our system—and found it can handle super long-horizon tasks end-to-end. 🍔 Sit back and enjoy the hamburger-making policy in action!

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: roboverseorg.github.io/ViTacFormerPag… Paper link: arxiv.org/abs/2506.15953 Github: github.com/RoboVerseOrg/V…