Simo Ryu

5.4K posts

Simo Ryu banner
Simo Ryu

Simo Ryu

@cloneofsimo

I like cats, math and codes [email protected]

Seoul, Republic of Korea Katılım Mayıs 2022
981 Takip Edilen17.4K Takipçiler
Sabitlenmiş Tweet
Simo Ryu
Simo Ryu@cloneofsimo·
This was work done last year, but my lazy ass uploaded it just this week It was huge fun working on this project.
Hanch Han@hanchchch

yesterday, @cloneofsimo and I released a tech report on the video pretraining research we worked on last year. we believe sharing our experience with the community building video models will be of great help! arxiv.org/abs/2603.00173

English
1
0
77
24.2K
Simo Ryu
Simo Ryu@cloneofsimo·
+ you can train control-following agent with PD control via PPO!!
English
0
0
1
619
Simo Ryu
Simo Ryu@cloneofsimo·
GPT 5.6 Sol made complete mujoco-like physics engine from scratch: gym-like api, c++ implemented, native headless render, web render, python native DSL to define environments instead of annoying XML ngl im not claiming its better than mujoco or its completely original, but it is pretty insane now you have some min-physics-engine implementation that is *actually legit ??* because its based on wasm very easy cross platforming. EVERYTHING was made with < 10 prompts cloneofsimo.github.io/lavendersim
Simo Ryu tweet mediaSimo Ryu tweet mediaSimo Ryu tweet media
English
3
4
72
5.1K
Simo Ryu retweetledi
will depue
will depue@willdepue·
‘“The electric light did not come from the continuous improvement of candles.” — Oren Harari’ — @cloneofsimo on agi
English
9
9
134
8.3K
Simo Ryu
Simo Ryu@cloneofsimo·
> ask 5.6 Sol Pro to build a 3D multibody simulator > it implements rigid-body dynamics from scratch > quaternion integration, OBB collision detection with 15-axis SAT contact and friction via sequential impulses > revolute-joint constraints > PD torque motors and a 12-joint quadruped controller > compiles the whole engine to WASM renders it with WebGL > gives me a working standalone HTML simulator one prompt this is getting ridiculous
English
10
10
177
28.7K
Simo Ryu
Simo Ryu@cloneofsimo·
Guysssssss stay in seoul for longer 🥲🥲🥲🥲
English
8
0
81
9K
Simo Ryu
Simo Ryu@cloneofsimo·
Ok I think my first party was pretty successful thanks to bass venture for sponsoring the place :)
Simo Ryu tweet mediaSimo Ryu tweet media
English
8
0
61
4.9K
Simo Ryu
Simo Ryu@cloneofsimo·
Today felt so weird because it felt like playing GTA Seoul edition but with San Francisco DLC
English
0
0
16
2.6K
Simo Ryu
Simo Ryu@cloneofsimo·
To all the seoul visiting bros Ping me and lets hang out if you are interested in video / image generative models
English
4
0
47
6K
Susan Zhang
Susan Zhang@suchenzang·
@giffmana @gabriberton based on this level of flag planting, unsupervised has been relegated to the corner of "absolutely no learning"
English
2
0
17
804
Gabriele Berton
Gabriele Berton@gabriberton·
I feel like people are replacing the term SSL with JEPA The PR tour has worked. Sad
Lucas Beyer (bl16)@giffmana

Quote-reply to Rohan because I think it can be interesting to many more. So there are two things you're missing here: 1) You're only looking at one specific instantiation of the general JEPA idea. There are many different instantiations. 2) The core JEPA idea (Joint Embedding Prediction Architecture) is to embed two "views" and predict one from the other. The views can be different augmentations, different time-steps, etc. Crucially, prediction happens in embedding space, which contrasts to predicting in data space as done by LLMs, diffusion models, MAEs, ... At least from the vision community, the main reason it got quite a bit of flak is that... literally everyone who was doing some self/un-supervised learning there has shared this thought already. MANY people did such models in the peak self-supervised period, which was ca 2017-2021. Then in 2022 comes Yann, slaps a new names on it, a paper with just the idea and no experiments to show for it, and goes on PR tour. That's why many didn't take it well. The core idea, almost everyone I know agrees is worth pursuing, especially since many already were doing so. It's very reminiscent of why Stanford got flak when they introduced and arguably tried to appropriate the "Foundation Model" term. That being said, by now foundation model has stuck and detached from Stanford, it may end up going similarly for JEPA.

English
10
8
233
49.4K
Simo Ryu
Simo Ryu@cloneofsimo·
@DeltaInstitutes Why are you inviting me to parties AND not letting me in AND excited to see me
English
0
0
12
575
Simo Ryu
Simo Ryu@cloneofsimo·
ICML overwatch PC cafe squad? 👀👀
English
9
0
45
11.7K
Simo Ryu
Simo Ryu@cloneofsimo·
Reality is "Simplicity is the king" is such normie thing to say. Frontier systems are rarely ever "simple".
Simo Ryu tweet media
Pranav Shyam@recurseparadox

@OfirPress This is mostly a matter of poor tooling and bad hyperparamter setups. A complex model can be as much as 10x more effective size if done without confounders. Era of dumb scaling is more over by the day imo

English
19
12
320
25.3K
darwin
darwin@jackalblackhole·
@Sauers_ Its just using terms of art in flowing prose without and substance or attaching any external meaning to anything
English
1
0
3
152
Sauers
Sauers@Sauers_·
Good explanation of what a Lie group is
Sauers tweet media
English
10
6
113
39K