Can GPT-4 teach a robot hand to do pen spinning tricks better than you do?
I'm excited to announce Eureka, an open-ended agent that designs reward functions for robot dexterity at super-human level. It’s like Voyager in the space of a physics simulator API!
Eureka bridges the gap between high-level reasoning (coding) and low-level motor control. It is a “hybrid-gradient architecture”: a black box, inference-only LLM instructs a white box, learnable neural network. The outer loop runs GPT-4 to refine the reward function (gradient-free), while the inner loop runs reinforcement learning to train a robot controller (gradient-based).
We are able to scale up Eureka thanks to IsaacGym, a GPU-accelerated physics simulator that speeds up reality by 1000x. On a benchmark suite of 29 tasks across 10 robots, Eureka rewards outperform expert human-written ones on 83% of the tasks by 52% improvement margin on average. We are surprised that Eureka is able to learn pen spinning tricks, which are very difficult even for CGI artists to animate frame by frame!
Eureka also enables a new form of in-context RLHF, which is able to incorporate a human operator’s feedback in natural language to steer and align the reward functions. It can serve as a powerful co-pilot for robot engineers to design sophisticated motor behaviors.
As usual, we open-source everything! Welcome you all to check out our video gallery and try the codebase today: eureka-research.github.io
Paper: arxiv.org/abs/2310.12931
Code: github.com/eureka-researc…
Deep dive with me: 🧵
These popsicle sticks have been intertwined so that the elastic potential energy is stored in their configuration.
Watch what happens when the elastic energy is released and turns into kinetic energy.
twitter.com/finetraitt/sta…
One of the best chatGPT hacks when it responds saying it can’t do something for some reason is to just lie to it and say that it can.
It will usually figure out a way around it and fulfill your request.
It’s very gullible lol
🚨NOT SO BREAKING NEWS
The @WhiteHouse does not seem to care about its American citizens while food prices are soaring, assistance programs failing, and the debt clock strikes $33.6 trillion the government decides foreign aid spending is a higher priority than putting that money into our failing economy.
Not only that but a large 14 billion dollar portion of that foreign aid is being sent to a murderous authoritarian occupational regime, Israel.
Why is @WhiteHouse sending this much money to a occupational force that is obviously slaughtering innocent civilians?! Like are we the bad guys now or have we been the actually terrorists?
We pay double for half the amount of groceries while our tax dollars are being funneled into a country committing war crimes on the daily…
To top it off our congressmen and women have been making millions of dollars from these poor sick choices purely driven by profit.
@WhiteHouse@JoeBiden@KamalaHarris@POTUS@VP@federalreserve your priorities are completely out of touch with what is truly needed.
@CommunityNotes Please can you add some valuable information that can provide some credibility to all of these easily provable claims.
#FreePalaestine
@YourAnonOne WHY ARE THEY SENDING MONEY TO THE ISRAELI GOVERNMENT?! Why not send it to Gaza and the Westbank?! Where hospitals are being overwhelmed and blown up by hostile Israeli forces?!
🚨 Israel has been the aggressor!
Palestinians lives are at risk! These are people who are suffering from the tyrannical leadership of the Israeli government.
Benjamin Netanyahu (Israeli Prime Minister) is a merciless authoritarian brute who’s dogma will result in the genocide of an indigenous population.
Hamas is a reaction of the continuing Israeli aggression not the other way around.
Please educate yourself on what is actually going on this coming world war is already so complex.
#FreePalaestine#IsraeliNewNazism
Did you know the Rothschild family has a Youtube channel with 27k subscribers? It's called Waddesdon Manor, and will blow your mind with how obscenely and unfathomably wealthy they are.
I don't think anyone truly has any idea how rich this family is. Trillionaires for sure, perhaps even quadrillionaires at this point with all assets evaluated together, including the hidden shadow central banking wealth if we ever had the means to audit all of it globally.
Even if we did audit these central banks and found that they have taken trillions of wealth away from various countries and it's people, what could we possibly do about it? It's unimaginable power. The power to create or destroy entire nations.