Marion Lepert

27 posts

Marion Lepert

Marion Lepert

@marionlepert

PhD Student @StanfordAILab | BS/MS @Stanford, Olympian

Katılım Ekim 2022
381 Takip Edilen689 Takipçiler
Sabitlenmiş Tweet
Marion Lepert
Marion Lepert@marionlepert·
Introducing Masquerade 🎭: We edit in-the-wild videos to look like robot demos, and find that co-training policies with this data achieves much stronger performance in new environments. ❗Note: No real robots in these videos❗It’s all 💪🏼 ➡️ 🦾 🧵1/6
English
17
39
285
66.6K
Marion Lepert
Marion Lepert@marionlepert·
@zuwang95 Thank you! In Fig 5, the Ours (no overlay) ablation does already correspond to Masquerade with no overlay + cotraining. The training pipeline was identical except that the video data used did not have overlays.
English
1
0
2
293
Zu Wang
Zu Wang@zuwang95·
Cool work! I’m particularly curious about one of the ablation studies. In Fig. 5, what would the success rate look like for no overlay + co-training? That might help disentangle the individual contributions of overlay and co-training to the final performance.
Marion Lepert@marionlepert

Introducing Masquerade 🎭: We edit in-the-wild videos to look like robot demos, and find that co-training policies with this data achieves much stronger performance in new environments. ❗Note: No real robots in these videos❗It’s all 💪🏼 ➡️ 🦾 🧵1/6

English
1
0
10
1.9K
Dima Damen
Dima Damen@dimadamen·
When googling the authors to tag them I realized this is an all-female author list, which made me even more excited... Big shout out to female rising stars @marionlepert @jiaying_fang0 and of course their advisor @leto__jean
English
3
0
11
914
Marion Lepert
Marion Lepert@marionlepert·
Masquerade outperforms baselines by 5-6x. Both robot overlays and co-training are indispensable for good performance. 🧵5/6
Marion Lepert tweet media
English
1
0
8
1.6K
Marion Lepert
Marion Lepert@marionlepert·
Introducing Masquerade 🎭: We edit in-the-wild videos to look like robot demos, and find that co-training policies with this data achieves much stronger performance in new environments. ❗Note: No real robots in these videos❗It’s all 💪🏼 ➡️ 🦾 🧵1/6
English
17
39
285
66.6K
Marion Lepert
Marion Lepert@marionlepert·
@JulienRineau_ We did not, but Rovi-Aug (closely related work for robot-to-robot transfer) did. They found they could avoid overlaying the virtual robot at inference by randomizing the lighting of the robot overlays during training.
English
0
0
1
314
Julien
Julien@JulienRineau_·
@marionlepert Great work! Curious if you tested the performance without overlaying the virtual robot at inference time?
English
1
0
0
344
Marion Lepert
Marion Lepert@marionlepert·
Introducing Phantom 👻: a method to train robot policies without collecting any robot data — using only human video demonstrations. Phantom turns human videos into "robot" demonstrations, making it significantly easier to scale up and diversify robotics data. 🧵1/9
English
14
67
492
53.9K
Marion Lepert
Marion Lepert@marionlepert·
@ChaoyiPan Thank you! Yes, although I think Phantom builds more closely off of Rovi-Aug, the authors' follow-up work on their original Mirage paper.
English
0
0
3
563
Marion Lepert
Marion Lepert@marionlepert·
Really grateful for amazing collaborators Jiaying Fang and @leto__jean. 🧵9/9
English
0
1
8
1.7K