Vongani Maluleke

When people share a space, their movements become intertwined. Embodied agents need to understand these social dynamics to interact effectively. Introducing MAGNet 🧲, a unified autoregressive diffusion forcing model for multi-agent motion generation that captures these interactions. MAGNet is flexible: predict the future, fill in missing motion, or have people react to each other, all while naturally scaling to N>2 people and generating ultra-long motion sequences.

@philippswu @xdofai @YideShentu @itsnemojin Congrats Phil!!!! 🎉🎉🎊🎉🎊🚀🚀

Announcing @xdofai: We’ve raised $70 million to build the core robotic infrastructure ecosystem for robot foundation models. My cofounders Fred (@YideShentu), Nemo (@itsnemojin) and I have been pursuing the dream of general purpose robots for our entire lives. After work at Covariant, Meta and Tesla, it became clear to us that general purpose robots are coming, and we are building XDOF to help make them a reality. For the last two years, we’ve been working behind the scenes to support major labs and companies deploying robots. In us, they have a partner with full-stack expertise, from hardware to operations to policy training. As our first public contribution to the space, we are open-sourcing ABC-130K, the largest open source teleoperation dataset, in collaboration with our partners from UC Berkeley, Carnegie Mellon, MIT and Amazon FAR. Thank you to our customers, partners, collaborators and investors for your trust and conviction in us. Together, we can accelerate the future of robotics!

New paper: Back into Plato’s Cave Are vision and language models converging to the same representation of reality? The Platonic Representation Hypothesis says yes. BUT we find the evidence for this is more fragile than it looks. Project page: akoepke.github.io/cave_umwelten/ 1/9

@funmilore Thanks Simeon!!! I appreciate you checking out our website🙏

MAGNet looks really cool and I really like how the website presents the details.

@davidrmcall Thank you David!!!😃

@vonekels Congrats!

When people share a space, their movements become intertwined. Embodied agents need to understand these social dynamics to interact effectively. Introducing MAGNet 🧲, a unified autoregressive diffusion forcing model for multi-agent motion generation that captures these interactions. MAGNet is flexible: predict the future, fill in missing motion, or have people react to each other, all while naturally scaling to N>2 people and generating ultra-long motion sequences.

@graceluo_ Thanks Grace!! Really spent a lot of time on our project page animations so I appreciate you noticing🙏🏽🤗

@vonekels Congrats Vongani! Also super cool project page, I love your training pipeline animation

Grateful for my amazing collaborators: @kiehoriuchi, @LeaMue27, Evonne Ng, @JitendraMalikCV, and @akanazawa Check out our paper, project page and code for more details: 📎Paper: arxiv.org/abs/2512.17900 🌐Page: von31.github.io/MAGNet 🖥️ Code: github.com/Von31/MAGNet-c…

Thanks @lisabdunlap for organizing a long overdue talk. -----Biltong Vs Beef Jerky Poll Results------ They came. They chewed. They voted. Biltong got 75% — Swi nandzika ngopfu!!

Happy to share our new work on Navigation World Models! 🔥🔥 Navigation is a fundamental skill of agents with visual-motor capabilities. We train a single World Model across multiple environments and diverse agent data. w/ @GaoyueZhou, Danny Tran, @trevordarrell and @ylecun.

We wrote a paper: estimating body and hand motion from a pair of glasses! 👓 website: egoallo.github.io code: github.com/brentyi/egoallo

Please see the website for more details. synNsync🪩is joint work with my awesome ✨co-authors✨: @LeaMue27 @jathushan @geopavlakos @shiryginosar @akanazawa @JitendraMalikCV Website🖥️: von31.github.io/synNsync/ Data💾: github.com/Von31/swing_da… Arxiv📜: arxiv.org/abs/2409.04440 🧵6/6

Sampling multiple predictions👯👯👯 from our model shows that knowing about the "other" helps generate diverse motion that is closer to the ground truth. 🧵5/6

To what extent does social interaction affect behavior in couples swing dancing? Our work looks at how we can predict a dancer's next moves based on their past motion alone or by considering both the dancer's and their partner's motions. 🪩🕺🏾 🆚 🪩🕺🏾💃🏾 🧵1/6

@vukosi @alienelf @CSIR @dsigovza @tamati_biskit Where it all started🤖!!! 😃 @vukosi thanks for sharing.

@alienelf @CSIR @dsigovza @tamati_biskit So many legends @vonekels 👋🏾

Blast from the past #DSIDE Program 2016/2017. Where are they now? What was DSIDE? -> dsideweb.github.io

I really had no idea who else was coming...lol

Super excited to share that I will be starting as an Assistant Professor at UT Austin @UTCompSci in January 2024! 🥳🥳 I'm extremely grateful to my amazing mentors and colleagues for their unwavering support every step of the way! Looking forward to this exciting new chapter!

While most existing methods that estimate 3D human pose and shape (HPS) do so in camera coordinates, many applications require 3D humans in global coordinates. At #CVPR2023, we introduce TRACE, which addresses this using a novel 5D representation. 1/6