galen

69 posts

galen banner
galen

galen

@G413N

https://t.co/Y845aeu05Z

wandering Katılım Mart 2023
94 Takip Edilen1.8K Takipçiler
Sabitlenmiş Tweet
galen
galen@G413N·
I'm really grateful that we get to work with such thoughtful and mission-oriented investors. Exciting times ahead!
Standard Intelligence@si_pbc

We’ve raised 75m in new funding from Sequoia and Spark Capital—partnering with @sonyatweetybird, @MikowaiA, and @YasminRazavi, all of whom are deeply supportive of our long-term mission. We’ve also brought on angels & advisors including @karpathy, @tszzl, and @_milankovac_. ----- Our early results with FDM-1 moved computer use from a data-constrained regime to a compute-constrained one; this latest round of funding unlocks several orders of magnitude of compute scaling for that work. With the FDM model series we have a path to scale agentic capabilities through video pretraining, and we expect to achieve superhuman performance on general computer tasks in the same way that current language models have superhuman performance on coding tasks. We’re also now able to invest in the blue-sky research necessary to our long term mission of building aligned general learners. To realize the civilizationally transformative impacts of AI, models must generalize far out of their training distributions, actively exploring and building skills in new environments. This capability represents a substantial shift from the current paradigm of model training. We believe that current alignment techniques are insufficient to predictably and safely steer a model with human-level learning capabilities, and so we’re doing work to study small versions of this problem in controlled environments to develop a science of alignment for general learners. We’re a team of 6 people in San Francisco. We’re hiring world-class researchers and engineers to help us achieve our mission. If that’s you, please get in touch.

English
5
4
115
13.5K
galen
galen@G413N·
Lachy called me up on thanksgiving day back in 2024 to offer to lead our seed round. At the time we had a few weeks of runway left and no one else had the conviction for a research bet. He's an incredibly impressive investor and an amazing person.
Lachy Groom@lachygroom

🥹 @si_pbc 🤝 @MikowaiA 🤝 @sonyatweetybird🤝 @lachygroom 🥹

English
2
1
164
20K
galen retweetledi
Ryan Kaufman
Ryan Kaufman@ryankaufman·
Delayed life update — I left @xai to join the amazing crew at @si_pbc. Loving the small team vibes and fast research cycle. Excited to show you what we’ve been cooking!
Standard Intelligence@si_pbc

We’ve raised 75m in new funding from Sequoia and Spark Capital—partnering with @sonyatweetybird, @MikowaiA, and @YasminRazavi, all of whom are deeply supportive of our long-term mission. We’ve also brought on angels & advisors including @karpathy, @tszzl, and @_milankovac_. ----- Our early results with FDM-1 moved computer use from a data-constrained regime to a compute-constrained one; this latest round of funding unlocks several orders of magnitude of compute scaling for that work. With the FDM model series we have a path to scale agentic capabilities through video pretraining, and we expect to achieve superhuman performance on general computer tasks in the same way that current language models have superhuman performance on coding tasks. We’re also now able to invest in the blue-sky research necessary to our long term mission of building aligned general learners. To realize the civilizationally transformative impacts of AI, models must generalize far out of their training distributions, actively exploring and building skills in new environments. This capability represents a substantial shift from the current paradigm of model training. We believe that current alignment techniques are insufficient to predictably and safely steer a model with human-level learning capabilities, and so we’re doing work to study small versions of this problem in controlled environments to develop a science of alignment for general learners. We’re a team of 6 people in San Francisco. We’re hiring world-class researchers and engineers to help us achieve our mission. If that’s you, please get in touch.

English
26
5
313
29.5K
galen retweetledi
Neel Redkar
Neel Redkar@_neelr_·
!!! time for more scale and more MFU optimization fun stuff (spent a week making our gpu traces go brrrr)
Standard Intelligence@si_pbc

We’ve raised 75m in new funding from Sequoia and Spark Capital—partnering with @sonyatweetybird, @MikowaiA, and @YasminRazavi, all of whom are deeply supportive of our long-term mission. We’ve also brought on angels & advisors including @karpathy, @tszzl, and @_milankovac_. ----- Our early results with FDM-1 moved computer use from a data-constrained regime to a compute-constrained one; this latest round of funding unlocks several orders of magnitude of compute scaling for that work. With the FDM model series we have a path to scale agentic capabilities through video pretraining, and we expect to achieve superhuman performance on general computer tasks in the same way that current language models have superhuman performance on coding tasks. We’re also now able to invest in the blue-sky research necessary to our long term mission of building aligned general learners. To realize the civilizationally transformative impacts of AI, models must generalize far out of their training distributions, actively exploring and building skills in new environments. This capability represents a substantial shift from the current paradigm of model training. We believe that current alignment techniques are insufficient to predictably and safely steer a model with human-level learning capabilities, and so we’re doing work to study small versions of this problem in controlled environments to develop a science of alignment for general learners. We’re a team of 6 people in San Francisco. We’re hiring world-class researchers and engineers to help us achieve our mission. If that’s you, please get in touch.

English
7
2
79
5.5K
galen
galen@G413N·
@tszzl and we have so much room to scale
English
1
0
33
1.6K
galen
galen@G413N·
@JunliWang2021 @si_pbc loved reading the paper when it came out! lots of similarities to our process
English
0
0
8
192
Junli Wang
Junli Wang@JunliWang2021·
Great work by @si_pbc! Teaching computer-using agents on 11 million hours of video data is an unbelievable achievement. We touched on this direction with VideoAgentTrek (thanks for the cite!), but the scale and efficiency they've introduced here are genuinely next-level. Exciting times for the community!
Standard Intelligence@si_pbc

Computer use models shouldn't learn from screenshots. We built a new foundation model that learns from video like humans do. FDM-1 can construct a gear in Blender, find software bugs, and even drive a real car through San Francisco using arrow keys.

English
3
3
42
5.2K
Standard Intelligence
Standard Intelligence@si_pbc·
Computer use models shouldn't learn from screenshots. We built a new foundation model that learns from video like humans do. FDM-1 can construct a gear in Blender, find software bugs, and even drive a real car through San Francisco using arrow keys.
GIF
English
187
396
3.9K
1.2M
galen
galen@G413N·
@Oli82817545 os world measures language models, they have eg a "number of actions" which doesn't make sense if you're outputting an action 30 times per second this is very early research, we'll release something once we scale and I expect we'll need harder benchmarks very soon
English
1
0
9
845
Oli
Oli@Oli82817545·
@G413N looks really cool but iam a bit sceptical whats the os world score? also when will it be available as open model or an api?
English
1
0
2
215
aidan
aidan@aidanmantine·
@si_pbc truly everything is computer
English
3
0
81
3.6K
galen
galen@G413N·
general intuition is really something special, it's been amazing to watch Pim go in an entirely new direction as a founder and blow it away on execution, the culture there is incredible and they're doing great work, honored to have made a difference :)
Pim de Witte@PimDeWitte

Very excited for the SI team - fun fact, General Intuition likely would not have existed without Galen and his early mentorship as I was getting started in the field after @lachygroom introduced us. Having mostly traditional researchers in my network, and nobody who was self-taught like Galen, it was great seeing people paving their own path and being so far ahead of the curve. Follow this team!

English
0
0
43
5.2K
gelleproductions
gelleproductions@glproductions·
@si_pbc Is there any plan to ever release this model to customers for computer use? Or is this just a research project?
English
1
0
5
1.2K
galen
galen@G413N·
we’re assembling a 30PB storage cluster in downtown sf. got custom engraved drives for people helping. dm if you’d like to drop by
galen tweet media
English
1
2
48
5.6K
galen
galen@G413N·
@Maciek51285880 @si_pbc hmm silence from the generation code sounds like something is bugged, is this on the default prompts provided?
English
0
0
1
46
Maciek
Maciek@Maciek51285880·
@si_pbc Guys I've tried everything to run this model. Both Ubuntu + RTX 4090 and Windows. No luck at all. From inference i get non completing results (silence or cracks) and from server/client i got total silence. Does anybody got any results from the code on gh? 😦
English
1
0
3
145
Standard Intelligence
Standard Intelligence@si_pbc·
At Standard Intelligence we’ve been researching scalable cross-modality learning. We’re excited to share some early results in the form of 𝗵𝗲𝗿𝘁𝘇-𝗱𝗲𝘃, an open-source, first-of-its-kind base model for full-duplex conversational audio. 1/
English
52
130
830
179K
galen
galen@G413N·
@samsja19 (and it's an uneven 6-mount rack for 4 gpus)
English
1
0
1
75
samsja
samsja@samsja19·
@G413N Nice, curious about the spacing between the gpus, wouldn't be better to be evenly spaced between them ?
English
2
0
0
157
galen
galen@G413N·
built a 4x4090 space heater recently, took abt a week of debugging to get it running nicely. Thread to add public knowledge---
galen tweet media
English
50
53
1.1K
193.5K