Siqiao Huang

288 posts

Siqiao Huang banner
Siqiao Huang

Siqiao Huang

@KnightNemo_

Rising senior undergrad, Yao class @Tsinghua_Uni | Current intern @uwcse | World Models, WAMs, Humanoid Foundation Models | RS @wuji_global | Prev. RA @mldcmu.

Katılım Ağustos 2024
1.4K Takip Edilen1.5K Takipçiler
Sabitlenmiş Tweet
Siqiao Huang
Siqiao Huang@KnightNemo_·
🤖✨Excited to share our new work: OMG: Omni-Modal Motion Generation for Generalist Humanoid Control What if a humanoid could understand intent from language, music/audio, human motion, or their combinations—and turn it into executable whole-body motion in real time? [🧵1/11]
English
3
32
170
12.9K
Siqiao Huang retweetledi
Matthew Hong ✈️ RSS2026
RL can't teach an LLM to solve problems it never solves. Robot policies suffer from exactly the same limitation. The fix turned out to be almost embarrassingly simple: train the policy with diffusion noise during pre-training. That's it. The policy covers a much wider action distribution, RL finally has somewhere to search, and we fine-tune VLAs on real robots in under an hour. Introducing TMRL. 🧵(1/9)
English
10
45
276
41.3K
Siqiao Huang
Siqiao Huang@KnightNemo_·
Auto-research and self-evolving AI are getting increasing attention, but many recent results still focus on toy settings like circle packing, where a cheap verifier lets models brute-force samples until something works. With 𝙼𝙻𝚂-𝙱𝚎𝚗𝚌𝚑, we ask the harder question: 𝑪𝒂𝒏 𝒇𝒓𝒐𝒏𝒕𝒊𝒆𝒓 𝒎𝒐𝒅𝒆𝒍𝒔 𝒂𝒄𝒕𝒖𝒂𝒍𝒍𝒚 𝒅𝒐 𝑴𝑳 𝒓𝒆𝒔𝒆𝒂𝒓𝒄𝒉 𝒂𝒏𝒅 𝒅𝒊𝒔𝒄𝒐𝒗𝒆𝒓 𝒔𝒄𝒂𝒍𝒂𝒃𝒍𝒆 𝒂𝒏𝒅 𝒈𝒆𝒏𝒆𝒓𝒂𝒍𝒊𝒛𝒂𝒃𝒍𝒆 𝒎𝒆𝒕𝒉𝒐𝒅𝒔, 𝒕𝒉𝒆 𝒌𝒊𝒏𝒅 𝒐𝒇 𝒎𝒆𝒕𝒉𝒐𝒅𝒔 𝒕𝒉𝒂𝒕 𝒉𝒂𝒗𝒆 𝒅𝒓𝒊𝒗𝒆𝒏 𝑴𝑳 𝒑𝒓𝒐𝒈𝒓𝒆𝒔𝒔 𝒕𝒉𝒊𝒔 𝒇𝒂𝒓? The answer is mostly no. Even today’s strongest models still do not discover genuinely useful algorithmic innovations like human scientists. Instead, they tend to recombine existing methods and make local engineering changes. Check out @Lyubh22 's thread below⬇️
Bohan Lyu@Lyubh22

Everyone is talking about self-evolving AI, or recursive self-improvement. The methods that built modern ML are the ones that keep working across settings and scales, yet no benchmark directly tests AI systems for that ability. Today, after months of cross-platform validation with external teams, we're proud to introduce MLS-Bench, a benchmark for ML Science with 140 tasks across 12 ML domains. It asks whether AI systems can create scalable and generalizable ML methods, the way human researchers have pushed AI forward. (1/9)

English
1
2
12
1.7K
Siqiao Huang retweetledi
Raymond Yu
Raymond Yu@yu_raymond5·
Potentially obvious finding: naively taking a policy trained on real-world data and fine-tuning it with RL in simulation can produce quite dangerous behavior… weirdlabuw.github.io/score/ 🧵👇
English
1
11
21
2.1K
Siqiao Huang retweetledi
Abhishek Gupta
Abhishek Gupta@abhishekunique7·
Policies trained on real robot data via imitation can be surprisingly capable. But for domains like dexterous manipulation, they are often not quite good enough: they move slowly, miss grasps, make unreliable contact, and fail under small perturbations. Can we improve them without any additional data collection on the real robot? In SCORE, we show that we can improve real-world diffusion/flow policies cheaply by using simulation to simply learn how to steer them on deployment. This leads to large gains in real-world success and speed across a variety of tasks, without requiring additional real-world experience: weirdlabuw.github.io/score/ 🧵 (1/10)
English
3
51
240
33.4K
Siqiao Huang retweetledi
Max Simchowitz
Max Simchowitz@max_simchowitz·
As a PhD student, I was told not to work on deep RL - too full of hacks and alchemy" But after a year or two of working in this area, I’ve come to (deeply?) appreciate all of the thoughtful research that’s gone into understanding what/why things work and how to make them better. My lab (joint with @abhishekunique7) took what we’ve learned by reading this body of literature to answer the question: what are the actual best-practices for finetuning a diffusion/flow/generative robot policy (for now, in sim)? Under one set of constraints - ample compute but limited time on your robot - @servo97 paper gives a pretty compelling answer.
Sarvesh Patil@servo97

Interaction with the real world is the major bottleneck in robot learning. So what would robot RL look like if we didn’t need to limit compute per interaction? Our latest work, Off-Policy Generative Policy Optimization (OGPO, accepted to ICML26) embarks on answering this question (spoiler alert: when done correctly, it helps massively!). 🧵(1/N)

English
22
34
367
35.6K
Siqiao Huang retweetledi
Thomas Zhang
Thomas Zhang@ThomasTCKZhang·
Super excited to finally announce our new paper “Double Preconditioning (DoPr): Optimization for Test-Time Performance, not Validation Loss” Tl;dr: from LLMs to robotics, on-policy deployment causes a mismatch between validation loss over the training distribution and “downstream performance”. We propose Double Preconditioning (DoPr), which drops in an activation-based preconditioner into your favorite gradient-wise whitener/normalizer, such as AdamW or Muon, to help close this gap. 1/12 🧵
Thomas Zhang tweet media
English
6
20
138
81.1K
Siqiao Huang
Siqiao Huang@KnightNemo_·
Thank you for featuring our work, being called "The GPT-4o moment for humanoids" is sth. special. We have a more detailed (and technical) thread here: x.com/KnightNemo_/st…
clankr@clankrmedia

The GPT-4o moment for humanoids might finally be here. And yeah, sorry in advance for the rickroll. OMG runs a Unitree G1 off one brain that natively takes language, audio, and human motion. That "Never Gonna Give You Up" dance isn't the flex; one model fluent in every modality is. Here's the shift. Most humanoid policies are one-trick. Train per skill, hand-tune the rewards, repeat. The rest just replay a fixed motion you feed them. OMG instead works like a biological motor system. A "brain" that turns intent into future motion. A "cerebellum" that reactively runs it on the robot. The brain is one diffusion model. Language, audio, a reference pose, or any blend goes in. A robot-ready G1 trajectory comes out, live. New inputs attach through zero-init adapters. They start at zero, so the pretrained motion prior carries over intact instead of getting scrambled. That's how they bolted on VR teleoperation as a brand-new modality, reusing the same brain. And it behaves like a foundation model. Bigger backbone, cleaner motion. Finetune on 1% of new data, nearly match a model trained from scratch on 100%. Compose language + audio at inference for combos never seen in training. 1000+ hours of motion, all retargeted into one G1 body. One brain that scales. We keep racing to build stronger low-level controllers. OMG's bet is that the real bottleneck is the brain mapping human intent to motion. Congrats to @KnightNemo_, @li_yitang, @ShaotingZ38103 and whole team!

English
0
1
13
3.8K
Siqiao Huang
Siqiao Huang@KnightNemo_·
Audio modality is mainly music/rhythm conditioning, we do not incorporate semantic information into audio-conditioning, which we believe can be controlled through language conditioning. There are a lot of amazing audio2text converters out there, maybe you can leverage this to achieve "humanoid siri"😂.
English
0
0
1
13
Alex Lu
Alex Lu@alexninghaolu·
@KnightNemo_ Awesome project! Quick question: does OMG support live voice-command control, or “audio” modality mainly music/rhythm conditioning? From the code, it looks like audio uses current35 features, while semantic instructions come from text?
English
1
0
0
15
Siqiao Huang
Siqiao Huang@KnightNemo_·
For audio-conditioned control, it can even generate dances conditioned on piano pieces played by ourselves😆, as well as some more down-to-earth pop music. [🧵 7/11]
English
2
1
5
352
Siqiao Huang
Siqiao Huang@KnightNemo_·
OMG is a collective effort, and I’m truly thankful to everyone who helped make it possible. Special thanks to for Prof. Hang Zhao @zhaohang0124 for guidance and trust, Guanqi @guanqi_he for mentorship, Kunying @kunying_lee -- pushing work at this scale as a freshman is absolutely stuning, and the whole team (@dongming_qiao, Zhenyu Wang, @li_yitang, @ShaotingZ38103) for their hard work. [🧵11/11]
English
0
0
2
477
Siqiao Huang
Siqiao Huang@KnightNemo_·
🤖✨Excited to share our new work: OMG: Omni-Modal Motion Generation for Generalist Humanoid Control What if a humanoid could understand intent from language, music/audio, human motion, or their combinations—and turn it into executable whole-body motion in real time? [🧵1/11]
English
3
32
170
12.9K