Gu Zhang

166 posts

Gu Zhang banner
Gu Zhang

Gu Zhang

@Gu__Zhang

CS PhD @Tsinghua_IIIS | Prev. Student Researcher @MIT_CSAIL @SJTU1896 | Research interest focus on dexterous manipulation

Katılım Ağustos 2021
521 Takip Edilen622 Takipçiler
Sabitlenmiş Tweet
Gu Zhang
Gu Zhang@Gu__Zhang·
#CVPR2026 Introducing UniDex — a foundation suite for universal dexterous hand control from egocentric human videos. We build a complete pipeline: human videos → 50K+ dexterous trajectories across 8 robot hands → one unified vision-language-action policy that controls all of them. Key highlights: 📊 UniDex-Dataset: 50K+ trajectories, 8 hands (6-24 DoFs) 🤖 FAAS: a unified dexterous action space enabling cross-embodiment transfer 🧠 UniDex-VLA: one 3D VLA policy for all different hands 🎯 81% task progress on 5 challenging tool-use tasks 🔄 Zero-shot cross-hand transfer UniDex is accepted to CVPR 2026. Fully open-sourced. 🌐 Project: unidex-ai.github.io 📄 Paper: arxiv.org/abs/2603.22264 💻 Code: github.com/unidex-ai/UniD… 🤗 Model: huggingface.co/UniDex-ai/UniD… 🧵 ↓
English
3
27
158
17.4K
Gu Zhang retweetledi
Suning Huang
Suning Huang@suning_huang·
🤖Low-data post-training can teach a VLA policy a new robot skill. But it also makes it too attached to the training demos. We call this lock-in🔒: the policy can execute the post-training task, yet fails to respond to seemingly obvious prompt changes. DeLock preserves steerability using only the policy’s own pretrained knowledge. No extra supervision needed!🚀🚀🚀 #Robotics #AI #EmbodiedAI #VLA
English
5
44
175
28.7K
Gu Zhang retweetledi
Generalist
Generalist@GeneralistAI·
GEN-1 puts plushies into polybags, in a warehouse outside the lab in New Hampshire.
English
14
60
445
100.4K
Gu Zhang
Gu Zhang@Gu__Zhang·
Very insightful work that tackles a deep yet often overlooked problem!
Younghyo Park@younghyo_park

What's different between these two BC policies? It's the same architecture, training budget, and data collection setup — the only difference is the controller gains! Controller gains are an understudied design parameter in robot learning. In our new work (w/ @BronarsToni*, @pulkitology), we show how they act as an inductive bias across BC, RL, and Sim2Real transfer, with real consequences on performance. Here's what we found 🧵 * Equal Contribution 📄arxiv: arxiv.org/abs/2604.02523 🔗website: younghyopark.me/tune-to-learn/

English
0
2
4
640
Gu Zhang retweetledi
Marwa ElDiwiny
Marwa ElDiwiny@MarwaEldiwiny·
The Utah/MIT Dextrous Hand ... 1982 A groundbreaking robot hand rarely talked about! Watching this old demo is pure gold!
English
10
21
161
19.4K
Gu Zhang
Gu Zhang@Gu__Zhang·
@felixwyw Congrats, yanwei! Very impressive work!
English
0
0
1
42
Felix Wang
Felix Wang@felixwyw·
It’s like unboxing a Christmas gift. You do not know exactly what is inside, but every now and then the model reveals a capability that stops you in your tracks. In those moments, you can feel that something genuinely new is emerging in real time. I feel incredibly lucky to help build and witness some of these moments firsthand.
Generalist@GeneralistAI

Hear more about GEN-1 and improvisational intelligence from our own researchers @coolboi95 and @felixwyw

English
2
7
36
5.1K
Gu Zhang retweetledi
Generalist
Generalist@GeneralistAI·
Introducing GEN-1. Our latest milestone in scaling robot learning. We believe it to be the first general-purpose AI model to master simple physical tasks. 99% success rates, 3x faster speeds, adapts in real time to unexpected scenarios, w/ only 1 hour of robot data. More🧵👇
English
51
279
1.7K
368.1K
Gu Zhang retweetledi
Robots Digest 🤖
Robots Digest 🤖@robotsdigest·
Dexterous robot hands have been stuck for years. Too expensive to train. Too hard to generalize. Too many DoFs to control. UniDex changes that—by learning hand control from human videos.
Robots Digest 🤖 tweet media
English
1
20
76
7.9K
Gu Zhang retweetledi
Binghao Huang
Binghao Huang@binghao_huang·
🤲Tactile sensing is powerful for robot manipulation, but hardware is still difficult to access, reproduce, and scale. 🎯That’s why we built FlexiTac: an open-source, low-cost, and scalable tactile sensing solution designed for real robotic systems. • Project page: flexitac.github.io We hope FlexiTac can help democratize tactile sensing for robotics research. (1/n)
English
8
37
229
41.3K
Gu Zhang retweetledi
Xiaomeng Xu
Xiaomeng Xu@XiaomengXu11·
Can we learn whole-body mobile manipulation directly from human demonstrations? Introducing Whole-Body Mobile Manipulation Interface (HoMMI) Egocentric + UMI, 0 teleop -> bimanual & whole-body manipulation, long-horizon navigation, active perception hommi-robot.github.io
English
11
71
320
60.1K
Reza Sayar
Reza Sayar@iamRezaSayar·
@Gu__Zhang Wow! 🔥🔥 awesome work! Congratulations to the entire team! 👏🤗
English
1
0
0
16
Gu Zhang
Gu Zhang@Gu__Zhang·
#CVPR2026 Introducing UniDex — a foundation suite for universal dexterous hand control from egocentric human videos. We build a complete pipeline: human videos → 50K+ dexterous trajectories across 8 robot hands → one unified vision-language-action policy that controls all of them. Key highlights: 📊 UniDex-Dataset: 50K+ trajectories, 8 hands (6-24 DoFs) 🤖 FAAS: a unified dexterous action space enabling cross-embodiment transfer 🧠 UniDex-VLA: one 3D VLA policy for all different hands 🎯 81% task progress on 5 challenging tool-use tasks 🔄 Zero-shot cross-hand transfer UniDex is accepted to CVPR 2026. Fully open-sourced. 🌐 Project: unidex-ai.github.io 📄 Paper: arxiv.org/abs/2603.22264 💻 Code: github.com/unidex-ai/UniD… 🤗 Model: huggingface.co/UniDex-ai/UniD… 🧵 ↓
English
3
27
158
17.4K
Gu Zhang retweetledi
Zhecheng Yuan
Zhecheng Yuan@fancy_yzc·
As human data scales in Embodied AI, systematic tools are vital. Introducing UniDex: a complete suite for dataset construction, hardware, and training. We aim to offer the community deeper insights into leveraging human-centric data.
Gu Zhang@Gu__Zhang

#CVPR2026 Introducing UniDex — a foundation suite for universal dexterous hand control from egocentric human videos. We build a complete pipeline: human videos → 50K+ dexterous trajectories across 8 robot hands → one unified vision-language-action policy that controls all of them. Key highlights: 📊 UniDex-Dataset: 50K+ trajectories, 8 hands (6-24 DoFs) 🤖 FAAS: a unified dexterous action space enabling cross-embodiment transfer 🧠 UniDex-VLA: one 3D VLA policy for all different hands 🎯 81% task progress on 5 challenging tool-use tasks 🔄 Zero-shot cross-hand transfer UniDex is accepted to CVPR 2026. Fully open-sourced. 🌐 Project: unidex-ai.github.io 📄 Paper: arxiv.org/abs/2603.22264 💻 Code: github.com/unidex-ai/UniD… 🤗 Model: huggingface.co/UniDex-ai/UniD… 🧵 ↓

English
1
10
25
4.1K
Gu Zhang retweetledi
WUJI TECH
WUJI TECH@wuji_global·
Cheers! Pretty cool work from Gu with our Wuji hand, we gonna bring better infra and hardware for all of our researchers🥰🥰🥰
Gu Zhang@Gu__Zhang

#CVPR2026 Introducing UniDex — a foundation suite for universal dexterous hand control from egocentric human videos. We build a complete pipeline: human videos → 50K+ dexterous trajectories across 8 robot hands → one unified vision-language-action policy that controls all of them. Key highlights: 📊 UniDex-Dataset: 50K+ trajectories, 8 hands (6-24 DoFs) 🤖 FAAS: a unified dexterous action space enabling cross-embodiment transfer 🧠 UniDex-VLA: one 3D VLA policy for all different hands 🎯 81% task progress on 5 challenging tool-use tasks 🔄 Zero-shot cross-hand transfer UniDex is accepted to CVPR 2026. Fully open-sourced. 🌐 Project: unidex-ai.github.io 📄 Paper: arxiv.org/abs/2603.22264 💻 Code: github.com/unidex-ai/UniD… 🤗 Model: huggingface.co/UniDex-ai/UniD… 🧵 ↓

English
0
6
8
1.1K
Gu Zhang
Gu Zhang@Gu__Zhang·
UniDex can be a useful foundation for the dexterous manipulation community. We believe scaling starts with leveraging the massive amount of human video data already out there. Core contributors here: @Gu__Zhang , Qicheng Xu, @HaoZhe1451 , @majianhan1, Long He, Yiming Bao. Also shoutout to @fancy_yzc, Chenhao Lu, @michaelyuancb, Tianhai Liang, Xiaoyu Tian, Maanping Shao, Feihong Zhang. Great thanks for the advise and support from Mingyu Ding, @gao_young @HaoZhao_AIRSUN, @zhaohang0124, @HarryXu12. 💻 Code: github.com/unidex-ai/UniD… 🤗 Model: huggingface.co/UniDex-ai/UniD… 🌐 Project: unidex-ai.github.io 📄 Paper: arxiv.org/abs/2603.22264
English
1
1
5
459