Ville🤖

2K posts

Ville🤖 banner
Ville🤖

Ville🤖

@VilleKuosmanen

gentleman scientist 🤖 @voyagerobotics

London, UK Katılım Mayıs 2020
859 Takip Edilen3.2K Takipçiler
Sabitlenmiş Tweet
Ville🤖
Ville🤖@VilleKuosmanen·
A month ago @pravsels and I set out to reproduce @physical_int’s RL Token paper. Today, I am sharing our research notes from the journey we’ve been on. x.com/VilleKuosmanen…
Ville🤖 tweet media
Ville🤖@VilleKuosmanen

"RL Token" looks like a great and surprisingly simple post-training methodology for optimising robot models for dexterous tasks in the real world! Over the next few weeks, me and @pravsels will be attempting to reproduce the results (& open source the code) Stay tuned 👀

English
1
13
123
16.5K
Ville🤖
Ville🤖@VilleKuosmanen·
@Francis_Aln yes but they are also 10x cheaper and far more commonly used than YAMs for example
English
0
0
0
7
Ville🤖
Ville🤖@VilleKuosmanen·
if anyone is interested in remotely accessing an so-101 arm farm, for any purpose (inc. evals, data collection, RL), DM me 😎
English
3
0
28
2.5K
Ville🤖
Ville🤖@VilleKuosmanen·
@omnomnihal @droyd_robotics I recommend investigating force torque sensors and/or controllers too, to plug in cables you need to apply specific amount of force which is hard to do with position control only
English
1
0
2
115
Nihal
Nihal@omnomnihal·
summer internship update: I’ll be working on VLAs at @droyd_robotics! Will be researching how different end effectors (to plug cables in) affect the policy. Might end up writing a paper on it. If you have any leads/have done similar work lmk!
English
2
1
16
1.4K
Ville🤖
Ville🤖@VilleKuosmanen·
is opus 4.7 getting worse? keeps forgetting things, doesn't understand root cause of issues even on extra high effort. esp bad in cloud system design, not understanding the diff in running locally vs in cloud are people vibe coding with this? what are they building with it?
English
1
0
3
457
Ville🤖
Ville🤖@VilleKuosmanen·
If that does describe you and you are or want to be london based let me know, DM's open 😁
English
0
0
0
188
Ville🤖
Ville🤖@VilleKuosmanen·
had a dream last night that I hired the perfect mechanical engineer to help us with some gripper and robot cell designs yet another part of my life getting consumed by work 🧐
English
3
0
14
854
Ville🤖
Ville🤖@VilleKuosmanen·
@masato_ka the motion tokens work I did some time ago was built on DP in LeRobot with very minor changes to the policy and these hyperparams I posted, so it definitely can work: @villekuosmanen/guiding-action-diffusion-policies-in-robots-via-motion-tokens-f8a5fe4ef8b1" target="_blank" rel="nofollow noopener">medium.com/@villekuosmane… the previous hyperparams were optimised for push-t which is much simpler than real robot
English
1
1
14
1.2K
masato_ka
masato_ka@masato_ka·
I’ve not heard success case DP training on LeRobot. We have to try again this.
Ville🤖@VilleKuosmanen

We just merged a small change to @LeRobotHF's default Diffusion Policy hyperparams, which should make it work better out of the box with real robots. If you've been using LeRobot to train mostly ACT policies, give a go to Diffusion Policy!

English
3
0
13
1.5K
Ville🤖
Ville🤖@VilleKuosmanen·
We just merged a small change to @LeRobotHF's default Diffusion Policy hyperparams, which should make it work better out of the box with real robots. If you've been using LeRobot to train mostly ACT policies, give a go to Diffusion Policy!
English
5
11
53
8.8K
Ville🤖
Ville🤖@VilleKuosmanen·
@pham_blnh @livekit the robot on rails looks great, would love to see that in action! how do you teleoperate the rail DOF?
English
1
0
1
151
Binh Pham
Binh Pham@pham_blnh·
collect data remotely using @livekit, infer remotely using @livekit excited for what’s to come, handling transport layer for robots should be as easy as setting up a call
English
3
6
29
1.4K
Ville🤖
Ville🤖@VilleKuosmanen·
@LeRobotHF (all depends on system config ofc, inc. type of GPU used, hard drive vs SSD, number of cameras, torchcodec vs pyav and so on)
English
0
1
2
544
Ville🤖
Ville🤖@VilleKuosmanen·
@LeRobotHF If you do end up testing DP, note that your training speed might be bottlenecked by data loading rather than GPU usage (use wandb system metrics to find out). If this is the case, you should increase the number of data loader workers, assuming your CPU has enough threads
English
1
1
2
605
Ville🤖
Ville🤖@VilleKuosmanen·
@DominiqueCAPaul don't show this video to your employer's liability insurance broker or whatever version of it you have in switzerland😅
English
1
0
5
271
Dominique Paul
Dominique Paul@DominiqueCAPaul·
So using relative joint angles with Pi0.5 isn’t going that well yet. I think it’s some bug in the inference loop. Need to think of a debugging visualization tomorrow.
English
15
3
136
13.1K
Ville🤖
Ville🤖@VilleKuosmanen·
@ax_pey Agreed, and I think there are many great use cases in elder and health care for specialised robots, such as the patient transfer robot developed by @AbleInnovation
English
0
1
3
149
Axel
Axel@ax_pey·
elder care is one of these fields that seems obvious but is a terrible first use-case for general-purpose robots - very low societal tolerance for any failure (humanoid kills grandpa inadvertently -> company dies) - very high loads required (carrying a human who fell) - all or nothing: either the robot deals with all the problems an elder has, or you will still have to send a human for some tasks, which defeats the purpose compare with some tasks for entertainment (dance) or early adopters (bring me a beer from the fridge) one day it will make sense to have them for elder care labor, but we're not there yet and until then you can maybe have interactive robots (but not general-purpose)
Lukas Ziegler@lukas_m_ziegler

elder care is probably the biggest labor crisis in the world. where are the robots?"

English
4
0
13
1.5K