illiquid

8.3K posts

illiquid banner
illiquid

illiquid

@lefttailguy

routers eat the world; consilient software observer; crafting an alchemist's paradise. DMs open.

palo alto Katılım Eylül 2020
600 Takip Edilen4.9K Takipçiler
Sabitlenmiş Tweet
illiquid
illiquid@lefttailguy·
All existing evidence points to the fact that our best-capitalized approach to AI development (scaling RL, SFT) requires the persistence of what @dwarkesh_sp very aptly summarized as a "massive black hole of data". The exponential bros will never stop trying to convince you that RSI is a discontinuity that's right around the corner and that once the system sees/does enough to "improve itself", this massive black hole of data (and the "temporarily" anti-competitive, Orwellian, centralized behavior it requires to persist) will be replaced by non-rivalrous access to aligned intelligence that's too cheap to meter. Don't worry guys, we are only temporarily restricting your ability to do AI research with our models! We're only temporarily altering performance based on who you are. Once the model is smart enough to iron out the wrinkles, AGI is a public good, a TFP subsidy, with equal access for all! Unfortunately, the only way we currently know to create something approximating a super intelligent system (one that can do everything better than anyone or anything) is by showing it everything! Real-world processes have irreducible time constants: you can't simulate the real world faster than real time. Therefore, to remain on the "frontier" in the way we think about it, the labs will either have to 1) incentivize or 2) coerce the continuous economy-wide production of the work data that makes these real world processes legible to their clusters. At present, the labs are using capital to "incentivize" this production and access: coding agent token subsidies (give us your engineer's decision traces), "deployment" joint ventures (let us turn your PortCo into an RL environment and we'll guarantee you 18% returns, preferential access to models, etc.), $2M in tokens for YC startups (we want traces from the firms with the fastest search/learning rates), Thrive Holdings etc. But its important to remember that the capital itself is born of coercion (not durable long term economic profits). The story is twofold: 1) if you don't give me the capital, China will win and turn the world into their gulag, and 2) is the Pascal's wager: if there is any possibility that this system can be built it's strictly irrational for you to not be a believer and owner. As capabilities increase, the coercive power of this narrative only accelerates. But these arguments become a lot less charismatic if capabilities stall. Absent a deliberate alternative architecture this creates increasing pressure toward centralized control over the domains where models are trained through deployment. And this is why the political economy of AGI is beginning to reject its development. To prevent the political economy from rejecting its development you either have to find a way to build a superintelligence without one entity seeing (and doing) everything in the economy or you have to change the political economy to be amenable to centralization. It's becoming clearer and clear than the labs, not having been able to come up with a good mechanism with which to capture durable value from a decentralized superintelligence, are forced to move to coercion and centralization. The sad thing is, this is all for naught. We will never beat China if our most well capitalized approach (“geniuses in a datacenter”) is implicitly contingent on centralization. Contingent because our current conceptualization, to succeed, fundamentally requires coercing the production of ever larger amounts of legiblized economic dark matter–”the data black hole” and sending it to the centralized entity with the compute necessary to train “machine god”. China’s political economy allows for centralization that ours never will (without a Civil War). The $295B cluster is just the start. And we have no clue what kind of crazy coercive data generation they are engaging in. So if we continue down this path, we will lose, unless you believe what Dario’s proposing—you will live in the pod, eat the bugs, use the only AI, and live on UBI—is charismatic enough to change America’s political economy. In this world, the economy will by definition have to become a gulag. An RL environment for machine god. Where your unique understanding of local reality becomes an input to a system that has the implicit goal of replacing you. I also happen to believe that this approach will create a strictly inferior "superintelligence", we know nature favors bottom's up emergence to top down coercion. Meta is focusing on creating a generically "SOTA" system, when really they should be focused on creating a SOTA system that arises naturally from their unique strengths. This is why employees feel like they are in the gulag: Meta's trying to turn work into a Gosplan for Cognition. Soon if we are not careful, the labs will try to do the same for the entire economy.
illiquid tweet media
illiquid@lefttailguy

China can distill Fable, but they can’t distill SpaceX’s ability to put 100 metric tons into orbit at less than $200 per kg. The govt banned Fable because Anthropic wanted the precedent of centralized control of AI to be set. Everything they’ve said and done points to this as their desired outcome. As the current leader, they think centralization is the only way to secure their primacy. And the govt unfortunately believed them. What they don’t realize is that Anthropic’s desire to centralize AI (to create one super intelligent model to rule them all) ensures that China will win. Because China’s ability to circumvent data and compute bottlenecks (through centralization) will be impossible to match. If we play that game. The only way we will win is through emergent super intelligence, born of our frontier firms privately instrumenting their scarce context (knowledge and knowhow) in a way that compounds (recursively self improves a la @Memetic_Theory) and emergently results in superior collective capability. @PalantirTech, @appliedcompute, @mercor_ai, and @joinHandshake are necessary to usher in this future.

English
4
9
107
43.7K
Francois Chaubard
Francois Chaubard@FrancoisChauba1·
~$100B of market cap has been created focused solely on selling data to frontier labs.. Scale AI ($29B), Surge AI ($15B), Mercor ($10B), Handshake ($3.3B), Invisible ($2B), Hive ($2B), Snorkel AI ($1.3B), Turing ($1.1B), Labelbox ($1B), micro1 ($500M), etc etc ... So on 8.12, @ycombinator is hosting a YC Paper Club in Mountain View focused on the most important driver of AI progress: Data Who wants to come? Who should present?
English
76
14
315
36.8K
S-Curve Capital
S-Curve Capital@S_curvecap·
I was already convinced but Q2 prints = more evidence that people simply don't know how to read or think for themselves anymore
English
3
0
30
3.9K
illiquid
illiquid@lefttailguy·
@iamgingertrash the world is run by valedictorians who also have killer instincts
English
0
0
14
748
simp 4 satoshi
simp 4 satoshi@iamgingertrash·
It’s like when the smartest kid in highschool goes into the industry and realizes he’s a worthless cog The world is not run by valedictorians It’s run by those who eat them
English
13
10
487
9.6K
simp 4 satoshi
simp 4 satoshi@iamgingertrash·
The problem with Dysgenic Tech Freaks is that they assume IQ is an equivalent substitute for being a Shark Playing circular LP games in Silicon Valley is not equivalent to competing against those who can smell blood a mile away
simp 4 satoshi tweet media
The Kobeissi Letter@KobeissiLetter

BREAKING: Situational Awareness sold "the bulk" of its stock portfolio to Citadel after "big losses in AI," per WSJ. The hedge fund, which reportedly had a net asset value of $45 billion on July 1st, is now in "crisis mode," WSJ reports.

English
81
148
3.2K
229.5K
illiquid
illiquid@lefttailguy·
My intuition is that data spend as a category is extremely hard to account for because it extends beyond standard contracts with data vendors. Internal headcount increasingly generates data, the labs are acquiring companies for data, and a lot of the deployment and investment efforts (e.g, Thrive Holdings and $2M Codex Credits for YC startups) are centered around data generation, etc.
English
0
0
1
25
illiquid
illiquid@lefttailguy·
@8bit5_0 Yes! Turns out women instinctively agree with you!
English
0
0
1
59
Coyote
Coyote@8bit5_0·
@lefttailguy haha idk i just find the authenticity refreshing. "what you see is what you get" vs subtle maneuvering (tech ppl are bad at this, so the subtly goes noticed)
English
1
0
2
73
Coyote
Coyote@8bit5_0·
I’ll take the frat bro over whatever the hell striver grifter archetype is now common in the valley.
TBPN@tbpn

.@travisk's commute takes 5 minutes on a jet ski going 70 mph on Lake Austin. "Who else do you know is jet skiing to work? Nobody. I'm the guy."

English
3
0
14
2.2K
illiquid
illiquid@lefttailguy·
@joodalooped @AnjanKatta The surface has been crafted to perfectly mimic the friction and feel of paper when writing.
English
0
0
0
32
judah
judah@joodalooped·
i am once again being tempted by the Daylight tablet feels like a bad idea...but a non-fatiguing screen would be really nice rn
English
12
0
39
2.8K
Dwarkesh Patel
Dwarkesh Patel@dwarkesh_sp·
By the way, the fact that Ant revenue has been 10x-ing year over year, while compute has only been 3x-ing, suggests that there are very strong economies of scale in the model business. Logically this makes sense - when you train a model, you pay this one time cost of learning all these different skills that you can then amortize across all your users. (Unlike with human labor, where each instance has to be retrained from scratch). I wish we didn't live in a world with such strong economies of scale of intelligence (because I'm worried about power concentration). But it seems we do.
Dwarkesh Patel@dwarkesh_sp

"Lab compute 3x-es year over year. For a lab to 10x revenue while continuing to only 3x compute, some combination of the following 3 things has to happen: 1. Lab margins have to increase, 2. The price of compute has to increase, 3. Labs have to spend a greater fraction of their compute on inference. My understanding is that basically all 3 of these things have been happening..." "Consider the price at which Google and Anthropic are renting compute from SpaceX. Google is reportedly paying $900 million a month for 110K GPUs [at] ... roughly 2x the spot price per hour for those GPUs. And the current spot price is itself 40% higher than it was in February."

English
56
56
1.3K
171.4K
signüll
signüll@signulll·
it’s esp funny cuz in nyc if you overhear any convo it’s usually ppl talking about other ppl like they’re at a build a bear workshop. “he’s 6’2 but i wish he wasn’t blond.” “he has nice style but i don’t like the way he walks.” this makes sense cuz ppl encounter so many ppl nowadays (lots of breadth, but very little if any depth). i had a running comedy bit i did where the broader joke was that the internet is simply an ecommerce interface for humans. the punchline was that hinge should replace the ❤️ with “add to cart.”
Jake Kozloski@jakozloski

Your grandparents met once at a church picnic and stayed married for 61 years. You have personally evaluated 11,000 people on your phone and eat dinner standing over a sink.

English
26
22
630
77.6K
illiquid
illiquid@lefttailguy·
@catboosted 🤣 coast = toast when I organize the class action
English
0
0
7
783
altra
altra@catboosted·
There is a grifter on the timeline trying to raise money for yet another human data company.
English
5
0
54
6.3K
illiquid
illiquid@lefttailguy·
@BenKlutsey @RMLLowe I misremembered, as of last year 13.79% of Thiel Fellows went on to start billion dollar+ businesses.
English
0
0
2
222
illiquid
illiquid@lefttailguy·
One thing that is very important to internalize: never bet against Peter Thiel's taste for talent. Paypal Mafia, Thiel Fellowship, and now Palantir Mafia. It's patently absurd. And it's not just signalling. Anyone who has worked with these folks know, they are real professionals. Have the extremely rare blend of genius and courage.
illiquid tweet media
English
10
23
402
39.3K
illiquid retweetledi
Bettina Warburg
Bettina Warburg@BWarburg·
Something eerie in reading this post after watching — by chance— both Ken Burns’s The American Revolution and The Matrix with my nephews this weekend. The digital political economy has never been sorted.
illiquid@lefttailguy

All existing evidence points to the fact that our best-capitalized approach to AI development (scaling RL, SFT) requires the persistence of what @dwarkesh_sp very aptly summarized as a "massive black hole of data". The exponential bros will never stop trying to convince you that RSI is a discontinuity that's right around the corner and that once the system sees/does enough to "improve itself", this massive black hole of data (and the "temporarily" anti-competitive, Orwellian, centralized behavior it requires to persist) will be replaced by non-rivalrous access to aligned intelligence that's too cheap to meter. Don't worry guys, we are only temporarily restricting your ability to do AI research with our models! We're only temporarily altering performance based on who you are. Once the model is smart enough to iron out the wrinkles, AGI is a public good, a TFP subsidy, with equal access for all! Unfortunately, the only way we currently know to create something approximating a super intelligent system (one that can do everything better than anyone or anything) is by showing it everything! Real-world processes have irreducible time constants: you can't simulate the real world faster than real time. Therefore, to remain on the "frontier" in the way we think about it, the labs will either have to 1) incentivize or 2) coerce the continuous economy-wide production of the work data that makes these real world processes legible to their clusters. At present, the labs are using capital to "incentivize" this production and access: coding agent token subsidies (give us your engineer's decision traces), "deployment" joint ventures (let us turn your PortCo into an RL environment and we'll guarantee you 18% returns, preferential access to models, etc.), $2M in tokens for YC startups (we want traces from the firms with the fastest search/learning rates), Thrive Holdings etc. But its important to remember that the capital itself is born of coercion (not durable long term economic profits). The story is twofold: 1) if you don't give me the capital, China will win and turn the world into their gulag, and 2) is the Pascal's wager: if there is any possibility that this system can be built it's strictly irrational for you to not be a believer and owner. As capabilities increase, the coercive power of this narrative only accelerates. But these arguments become a lot less charismatic if capabilities stall. Absent a deliberate alternative architecture this creates increasing pressure toward centralized control over the domains where models are trained through deployment. And this is why the political economy of AGI is beginning to reject its development. To prevent the political economy from rejecting its development you either have to find a way to build a superintelligence without one entity seeing (and doing) everything in the economy or you have to change the political economy to be amenable to centralization. It's becoming clearer and clear than the labs, not having been able to come up with a good mechanism with which to capture durable value from a decentralized superintelligence, are forced to move to coercion and centralization. The sad thing is, this is all for naught. We will never beat China if our most well capitalized approach (“geniuses in a datacenter”) is implicitly contingent on centralization. Contingent because our current conceptualization, to succeed, fundamentally requires coercing the production of ever larger amounts of legiblized economic dark matter–”the data black hole” and sending it to the centralized entity with the compute necessary to train “machine god”. China’s political economy allows for centralization that ours never will (without a Civil War). The $295B cluster is just the start. And we have no clue what kind of crazy coercive data generation they are engaging in. So if we continue down this path, we will lose, unless you believe what Dario’s proposing—you will live in the pod, eat the bugs, use the only AI, and live on UBI—is charismatic enough to change America’s political economy. In this world, the economy will by definition have to become a gulag. An RL environment for machine god. Where your unique understanding of local reality becomes an input to a system that has the implicit goal of replacing you. I also happen to believe that this approach will create a strictly inferior "superintelligence", we know nature favors bottom's up emergence to top down coercion. Meta is focusing on creating a generically "SOTA" system, when really they should be focused on creating a SOTA system that arises naturally from their unique strengths. This is why employees feel like they are in the gulag: Meta's trying to turn work into a Gosplan for Cognition. Soon if we are not careful, the labs will try to do the same for the entire economy.

English
0
1
1
1.1K