David Chen
7.1K posts

David Chen
@chenosaurus
GM Robotics @LiveKit. Building the platform for realtime Physical AI. Previously @Agtonomy, @skycatch, @twitter.
San Francisco, CA Katılım Temmuz 2008
2.8K Takip Edilen7K Takipçiler

3 thoughts.
1. The whole body manipulation of the basket is dope. It's easy to forget how much humans use this.
2. Glad they kept audio and 1x speed. The robot is still loud but way less stomping then a year ago.
3. Still a demo and still mostly pick and place
Figure@Figure_robot
Today we're showing Helix 02 that can tidy a living room fully autonomously Figure is designed so when you leave the house, your home resets exactly how you like it
English

Come join us at our next Physical AI Meetup, where we'll be discussing the challenges of deploying robots in homes with @tonyzzhao from @sundayrobotics, @itsdanielho from @1x_tech, and @kaandogrusoz from @weaverobotics! 🤖🤖🤖
luma.com/physical-ai-me…
English


@JohannesTscharn @Spectacles Very cool. Tell Claude to integrate LiveKit Agent for the voice interaction loop.
English

Hooked up Reachy to an LLM and made a couple of tools like detect_objects or look_at
It can now essentially reason about the space it’s in by using @Spectacles AR
TTS latency is still high and needs a better solution, Claude 4.6 is already working on it 😎
English
David Chen retweetledi

as promised, second part on learning world model learning is up
github.com/pham-tuan-binh…
the focus is on inverse dynamics this time, arguably the most important component of modern world models
this comes from a very first principle question “how can we train a world model without action labels”
again, we go through stuff like:
> different conditioning strategies (mentioned in DiT) like adaptive layer norm to just simple addition
> avoiding modal collapse through masking
and more practical stuff when it comes to the reconstructive loss function of an inverse dynamics model vs a dynamics model
p/s:
i have to say, the progress on world models has been absolutely insane during the time i write this.
for example, two weeks ago, nvidia releases cosmos policy which has no inverse dynamics model, no action head, only one single video world model to rule them all.
then just this week, they dropped a bombshell called dreamzero to show zero shot behavior on world model based planning.
on a practical note, you'll be surprised on how much inverse dynamics is NOT used in the field, but that is for another day.

English

@AnselDias Have you tried stereo cam to VR? The depth sense actually helps a ton.
English

First time doing camera-only teleop.
I was trying to see how well I can pilot it without looking directly at the scene. If I can't do it, neither can the AI, right?
Currently I just have a 4k 60FPS monocamera on it making depth perception hard. Plan to add wrist cams soon.
San Francisco, CA 🇺🇸 English

Culture shift in SF as more hardware folks come in
If you work on hardware come grab a beer Thursday
realhardwarepatriots.com
English

@Sethnuzum I'll def play with the free version to get a better sense of the features!
English

@chenosaurus It can be, but I was actually just using the free version with the watermark!
Definitely try to build something better with Claude and let me know. Would love another option.
English

@Sethnuzum Oh wow, expensive!
Been playing with Lazy Lighting on iOS and wanted to move to a desktop more easier interaction with the layout.
Wonder if Claude can build something with Three.js...
English
David Chen retweetledi

Remembering how my mom got the hot tip about Covid from WeChat before everyone else here knew.
David Chen@chenosaurus
My mom, who works as a nurse in a hospital, just told me to prep 30 days of food/water for the corona virus, just in case. 😷🦠
English

@varoomer @pollenrobotics @huggingface @livekit Haven’t published it yet. Will try to wrap it this weekend!
English

Gave @pollenrobotics @huggingface Reachy voice, sight, and motion with a @livekit agent. It feels alive. 🤖👻
English

@johnheywood @ellenjdasilva There was a event last month in NYC with a bunch of local robotics startups. Would be a good list to look at. luma.com/event/evt-0nL8…
English

@chenosaurus @pollenrobotics @huggingface @livekit You should make a Reachy dashboard app from it and share it on the hub!
English










