Sandeep Bajamahal @ ICML🇰🇷

13 posts

Sandeep Bajamahal @ ICML🇰🇷

Sandeep Bajamahal @ ICML🇰🇷

@sandeep_b24

EECS @UCBerkeley, Intern @nvidia, Undergrad Researcher @AUTOlab_Cal @berkeley_ai

Katılım Ağustos 2025
68 Takip Edilen27 Takipçiler
Sandeep Bajamahal @ ICML🇰🇷 retweetledi
Justin Yu
Justin Yu@uynitsuj·
Introducing WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data Curation 🧵 We gave our t-shirt folding robot more demonstrations and it got worse. Every extra demo ended in a successfully folded shirt. The data wasn't bad. It was noisy. The policy couldn't tell productive motion from dead time, and it imitated both equally. So which moments of a demo are actually worth copying? 🌐 Project Website: uynitsuj.github.io/warp-rm 📄 Paper: arxiv.org/abs/2606.28320 💻 Code: github.com/uynitsuj/WARP-… 📨 XDOF blog post: xdof.ai/blog/warp-rm
English
6
25
160
35.1K
Sandeep Bajamahal @ ICML🇰🇷 retweetledi
Rutav
Rutav@rutavms·
Can we build generalist robots with zero teleoperation? Come participate in the discussion and weigh in at our ICRA'26 workshop, BeyondTeleop, starting at 8.45 am CEST today (June 5th)! 📍 Strauss 3
Rutav tweet media
English
3
24
47
6.4K
Sandeep Bajamahal @ ICML🇰🇷 retweetledi
Sandeep Bajamahal @ ICML🇰🇷 retweetledi
Max Fu
Max Fu@letian_fu·
Robotics: coding agents’ next frontier. So how good are they? We introduce CaP-X: an open-source framework and benchmark for coding agents, where they write code for robot perception and control, execute it on sim and real robots, observe the outcomes, and iteratively improve code reliability. From @NVIDIA @Berkeley_AI @CMU_Robotics @StanfordAILab capgym.github.io 🧵
English
20
125
632
173.8K
Sandeep Bajamahal @ ICML🇰🇷
Walking seems simple until you try to teach a robot to do it. 🤖 I used the Soft Actor-Critic (SAC) RL algorithm to train a bipedal walker. My deep dive covers the math and some findings from vision-based & stabilized approaches: @sunny.bajamahal/learning-to-walk-with-reinforcement-learning-191560eaa283" target="_blank" rel="nofollow noopener">medium.com/@sunny.bajamah… Details threaded 🧵
English
4
0
0
100
Sandeep Bajamahal @ ICML🇰🇷
💡The biggest win came from episode scaling. Gradually increasing episode duration prevented the critic network from overfitting to stationary data early on. This allowed it to experience more crucial failures, stabilizing and speeding up training significantly. 📈
Sandeep Bajamahal @ ICML🇰🇷 tweet media
English
0
0
0
42
Sandeep Bajamahal @ ICML🇰🇷
🧠 Standard Q-Learning struggles with the continuous action spaces needed for robotic joints. SAC solves this by maximizing entropy (randomness) alongside reward. It encourages the robot to try weird movements (exploration) before settling on the best stride (exploitation).
English
0
0
0
42