Jeremy

187 posts

Jeremy banner
Jeremy

Jeremy

@JeremyVarkey

Descendent of Aladdin

Seattle, WA Katılım Ocak 2012
934 Takip Edilen164 Takipçiler
Jeremy
Jeremy@JeremyVarkey·
@petergyang I think the issue is there’s a large swath of people that feel they can’t do that Europe or Asia lifestyle without the nest egg that the labs or FAANG offer
English
0
0
3
1.6K
Peter Yang
Peter Yang@petergyang·
If you're stuck in the Bay Area tech rat race / psychosis, make time to travel to other places. Go to a small town in Europe or visit Asia - you'll see that life can be about much more than whether you're IC7 or IC8 or what company you work for. Don't be the person to put on your tombstone: "He got divorced and neglected his kids but at least he made D2 at FAANG"
Deedy@deedydas

The vibes in SF feel pretty frenetic right now. The divide in outcomes is the worst I've ever seen. Over the last 5yrs, a group of ~10k people - employees at Anthropic, OpenAI, xAI, Nvidia, Meta TBD, founders - have hit retirement wealth of well above $20M (back of the envelope AI estimation). Everyone outside that group feels like they can work their well-paying (but <$500k) job for their whole life and never get there. Worse yet, layoffs are in full swing. Many software engineers feel like their life's skill is no longer useful. The day to day role of most jobs has changed overnight with AI. As a result, 1. The corporate ladder looks like the wrong building to climb. Everyone's trying to align with a new set of career "paths": should I be a founder? Is it too late to join Anthropic / OpenAI? should I get into AI? what company stock will 10x next? People are demanding higher salaries and switching jobs more and more. 2. There’s a deep malaise about work (and its future). Why even work at all for “peanuts”? Will my job even exist in a few years? Many feel helpless. You hear the “permanent underclass” conversation a lot, esp from young people. It's hard to focus on doing good work when you think "man, if I joined Anthropic 2yrs ago, I could retire" 3. The mid to late middle managers feel paralyzed. Many have families and don't feel like they have the energy or network to just "start a company". They don't particularly have any AI skills. They see the writing on the wall: middle management is being hollowed out in many companies. 4. The rich aren’t particularly happy either. No one is shedding tears for them (and rightfully so). But those who have "made it" experience a profound lack of purpose too. Some have gone from <$150k to >$50M in a few years with no ramp. It flips your life plans upside down. For some, comparison is the thief of joy. For some, they escape to NYC to "live life". For others still, they start companies "just cuz", often to win status points. They never imagined that by age 30, they'd be set. I once asked a post-economic founder friend why they didn't just sell the co and they said "and do what? right now, everyone wants to talk to me. if i sell, I will only have money." I understand that many reading this scoff at the champagne problems of the valley. Society is warped in this tech bubble. What is often well-off anywhere else in the world is bang average here. Unlike many other places, tenure, intelligence and hard work can be loosely correlated with outcomes in the Bay. Living through a societally transformative gold rush in that environment can be paralyzing. "Am I in the right place? Should I move? Is there time still left? Am I gonna make it?" It psychologically torments many who have moved here in search of "success". Ironically, a frequent side effect of this torment is to spin up the very products making everyone rich in hopes that you too can vibecode your path to economic enlightenment.

English
135
177
3.6K
487K
Jeremy
Jeremy@JeremyVarkey·
@teortaxesTex How can they, when they keep selling it al!?
English
0
0
0
179
Jeremy
Jeremy@JeremyVarkey·
@TheStalwart While the models are objectively useful, it takes time to learn how to use them effectively. Most of these folks (esp at Amzn) are already stretched; taking more time to invest in learning, during work hours where your responsibilities are only increasing, is a tough sell
English
1
1
14
1.1K
Joe Weisenthal
Joe Weisenthal@TheStalwart·
Here's what's weird about this Amazon tokenmaxxing story to me. How is it that, online, there's so much consensus that the models are objectively useful for coding, and that 80% is a "target" for developer use. Why wouldn't they all be using it it makes their job easier?
Joe Weisenthal tweet media
Joe Weisenthal@TheStalwart

The FT says that Amazon employees are doing random unnecessary task automations to consume tokens and to show their bosses that they're using AI more ft.com/content/8ee0d3…

English
115
18
399
99.4K
Jeremy
Jeremy@JeremyVarkey·
@peterrhague The biggest things killing small local business are commercial rent (which doesn’t seem to adjust down for a cities macro environment) and permitting
English
1
0
17
1.3K
Jeremy
Jeremy@JeremyVarkey·
@simpsoka @Dimillian Stability when using Excel. Seems to make the files corrupt unless it’s actively open (without autosave)
English
0
0
0
120
Kath Korevec
Kath Korevec@simpsoka·
Windows Codex users. Tell me the good bad and ugly. Where do we need to dig in?
English
417
18
460
94.2K
dominik kundel
dominik kundel@dkundel·
One of the coolest things with Codex for Chrome is combining it with subagents so you can test things like multiplayer games! Available for both macOS and Windows. Happy Codexing
English
71
78
1.3K
159.3K
Jeremy
Jeremy@JeremyVarkey·
@jaminball The best folks to poll would be the ones at the hyperscalers actually selling capacity, no?
English
0
0
0
249
Jamin Ball
Jamin Ball@jaminball·
Responses to this have been interesting, and fall into 2 buckets. And to be clear - zero inside knowledge from either side of the transaction. But here’s the two types of responses: 1) from people at other large labs / neoclouds: “you’re too low on your rental price assumptions” 2) from everyone else: “you’re way too high on your rental price assumptions” We’re still early in the compute buildout. This feels like one of the more compute constrained environments I can remember! Seems like majority of the world still underestimating the upside. Risk is to the upside in these large platform shifts!
Jamin Ball@jaminball

Some rough math! (All napkin math...) Assume Colossus 1 has 220k GPUs Assume 150k H100s, 50k H200s, 20k GB200s Pricing Assumptions: - $2.30 / hour for H100s - $2.60 / hour for H200s - $5 / hour for GB200s - blended rental rate across the entire fleet of $2.60 / hour Assume it's all take-or-pay style deals (you pay for 24x365 usage) This translates to ~$5b of annual rev to Xai. We have a new neocloud! On top of that - on recent Dwarkesh podcast, Dario ran through some napkin math on unit economics (he framed it all as industry math vs Anthropic specific - which is important, he wasn't disclosing anything Anthropic specific). What he mentioned was take $100b of compute spend (he just picked a round number). There will be a mix shift of that spend between training and inference. Skew too much on training and you don't generate enough revenue. Skew too heavy on inference and you kneecap future R&D progress. He thought the industry is currently 50/50 on training / inference of compute spend. He said as in industry, could turn that $50b inference spend into $150b of revenue (called out these are most likely the unit economics of the industry in 1-2 years) So taking this back to the Xai deal. Under above assumptions, Anthropic paying $5b / year. Let's say they turn that into $15b / year in rev (60-70% gross margin) Win win!!

English
3
8
91
21.9K
Jeremy
Jeremy@JeremyVarkey·
@dawanahidua @digitalix Idk, having an always on ambient ai device is something I’d use. Hate reaching for my phone. Glasses seem like the best medium for this though
English
0
0
0
91
Z
Z@dawanahidua·
@JeremyVarkey @digitalix That's wasn't the only problem though. People just don't like carrying other devices. I mean why would you... when iPhones can do the same thing?
English
1
0
4
893
Alex Ziskind
Alex Ziskind@digitalix·
funny looking back, you can tell who actually cared about their product and who just wanted a quick money grab. I still get emails from rabbit about improvements they are making.
Alex Ziskind tweet mediaAlex Ziskind tweet media
English
84
34
2.6K
524.2K
Jeremy
Jeremy@JeremyVarkey·
@MostlyMonkey Everything in moderation. If FIRE is forcing you to live on beans and rice, not worth it. If FIRE is forcing you to to stop eating steak every night, it’s worth it It’s essentially a way to think hard about “is this lifestyle worth it”
English
0
0
4
240
Jeremy
Jeremy@JeremyVarkey·
@TheStalwart Is this any different than a random source found via a google search?
English
0
0
0
334
Joe Weisenthal
Joe Weisenthal@TheStalwart·
The critics who talk about LLM's hallucination problem are, IME, completely correct. Other than for coding, I just use the chatbots as glorified search engines, and I don't think you should trust a word they say if you can't find a link to back it up.
English
140
126
2.4K
334K
Jeremy
Jeremy@JeremyVarkey·
@petergostev It’s tough to supply compute to both a revenue generating customer / competitor, and also fun your own internal efforts. In that sense, the private cos are better off since they aren’t beholden to quarterly reports
English
0
0
1
857
Peter Gostev
Peter Gostev@petergostev·
It's so curious to me, doesn't look like Google is serious about AI. They've been investing in Anthropic for years, selling them TPUs, and basically diverting resources from Gemini while it is cracking under capacity constraints. Imagine OpenAI selling capacity to their core competitor to make a quick buck on the side. I'd be pissed of I was a DeepMind exec.
Anthropic@AnthropicAI

We've signed an agreement with Google and Broadcom for multiple gigawatts of next-generation TPU capacity, coming online starting in 2027, to train and serve frontier Claude models.

English
111
6
665
187.3K
Jeremy
Jeremy@JeremyVarkey·
@martin_casado @seyitaylor People get obsessed with output, and tokens/PRs/etc. are the most readily available, if fallible, indicators. It is starting to feel like token usage is getting gamified, though
English
0
0
0
20
martin_casado
martin_casado@martin_casado·
Total token use as a measure of AI literacy is wrong headed. In my experience, after some baseline, more token use is inversely correlated with competency using AI.
English
86
33
402
38.3K
Jeremy
Jeremy@JeremyVarkey·
@karrisaarinen Hopefully they run with interoperability vs bundling. Feels like Codex threads are a wealth of context on what I’m up to. I’d love to reference those threads in a chat
English
1
0
0
201
Karri Saarinen
Karri Saarinen@karrisaarinen·
IMO they should bundle ChatGPT and browser but keep Codex out of it. The use and usage patterns are different and you might hurt Codex by bundling it
Olivia Moore@omooretweets

As an early superfan of AI browsers, ChatGPT moving towards a desktop app instead actually makes sense to me. Perplexity Comet has been arguably the most successful product here - and while they have a real base of power users, it's been hard to maintain growth 👇 We've seen this in the past with other fantastic browser products like Dia / Arc - there are a few things that make building a mainstream new browser very hard: 1. It's an extremely high frequency product where users have little tolerance for changes. If even one workflow is disrupted or made more difficult, it's like a paper cut that the user then experiences 100x a day. 2. The browser behavior is so automatic that the physical act of switching and maintaining the switch is hard! There has to be something in the new browser that's so materially better such that you remember to use it. And, if you have to onboard users to the product, you’ve lost. 3. There’s not that much “space” to innovate in the browser. The most important thing is to not disrupt the core experience, and so much is available via extensions that unlocking a 10x for the mainstream user is hard. Chrome works decently well - it’s not a low NPS product where people are desperate to switch. In contrast, desktop apps have proven to be a very fruitful surface for AI-enhanced work - think Cursor, Cowork, etc. Now that you can give a desktop product browser access, the advantage is clear - especially when the desktop app also has native file access and feels more natural to set up recurring workflows in.

English
17
3
64
17.1K
Jeremy
Jeremy@JeremyVarkey·
@andrewchen Spreadsheets are effectively point-and-click programming. The input-output is standard and inspectable no matter who is using the spreadsheet So long as AI code gen is non deterministic, it’s hard to see it replacing Excel. It will augment it, but not replace it
English
0
0
0
901
andrew chen
andrew chen@andrewchen·
prediction re the end of spreadsheets AI code gen means that anything that is currently modeled as a spreadsheet is better modeled in code. You get all the advantages of software - libraries, open source, AI, all the complexity and expressiveness. think about what spreadsheets actually are: they're business logic that's trapped in a grid. Pricing models, financial forecasts, inventory trackers, marketing attribution - these are all fundamentally *programs* that we've been writing in the worst possible IDE. No version control, no testing, no modularity. Just a fragile web of cell references that breaks when someone inserts a row. The only reason spreadsheets won is that the barrier to writing real software was too high. A finance analyst could learn =VLOOKUP in an afternoon but couldn't learn Python in a month. AI code gen flips that equation completely. Now the same analyst describes what they want in plain English, and gets a real application - with a database, a UI, error handling, the works. The marginal effort to go from "spreadsheet" to "software" just collapsed to near zero. this is a massive unlock. There are ~1 billion spreadsheet users worldwide. Most of them are building janky software without realizing it. When even 10% of those use cases migrate to actual code, you get an explosion of new micro-applications that look nothing like traditional software. Internal tools that used to live in a shared Google Sheet now become real products. The "shadow IT" spreadsheet that runs half the company's operations finally gets proper infrastructure. The interesting second-order effect: the spreadsheet was the great equalizer that let non-technical people build things. AI code gen is the *next* great equalizer, but the ceiling is 100x higher. We're about to see what happens when a billion knowledge workers can build real software.
English
434
290
3.1K
1.3M
Jeremy
Jeremy@JeremyVarkey·
@emollick The models are at a place where, with the right workflow, we can accelerate a lot of white collar work. The compute isn’t there yet though, and that is the chief risk with the bubbling anti-Datacenter sentiment
English
0
0
0
23
Ethan Mollick
Ethan Mollick@emollick·
We really could stop AI development right now and it would still transform a substantial portion of white collar work, often unrecognizably, over the next 5-10 years as people figure out how to make the technology work in various industries, even given current models' limitations
English
94
115
1.1K
50.4K
Jeremy
Jeremy@JeremyVarkey·
@ArrowSynthesis @NostalgiaFolder Sterilized feels like the operative word. It feels like every cool new thing that gets launched gets immediately neutered now. Case in point: bing copilot when it was Sydney
English
0
0
0
66
Tenebraeth
Tenebraeth@Tenebraeth·
@NostalgiaFolder Peak Americana. The internet before it was sterilized in the 00's Life before the panopticon was put into place. Before 2 and a half decades of war, inflation, the 24/7 news cycle, and social media warped everything into a caricature.
English
14
19
527
19.4K
Nostalgia
Nostalgia@NostalgiaFolder·
Why is 1990s nostalgia still so dominant compared to other decades?
English
980
339
4.8K
2.8M
Jeremy
Jeremy@JeremyVarkey·
@altcap Model training is so dang expensive, but model inferencing is so dang profitable especially as customers cache to optimize their own spend. Holy grail will be a model that can train itself
English
0
0
0
1.8K
Brad Gerstner
Brad Gerstner@altcap·
These will prove to be among the dumbest takes of the AI era. Given how early we are & how much competition exists including free & capable models - I am shocked at the high & improving gross margins of the leading model providers. The tokens are very profitable. 🧐💰
Austin Rief ☕️@austin_rief

We are in the golden age of AI. Go thank a VC near you. A $200 monthly subscription to Claude can consume $5,000 in compute. This reminds me of when I was in college and Ubers were $3.

English
34
20
376
203.2K
Joe Weisenthal
Joe Weisenthal@TheStalwart·
Is it safe to assume that use of AI models through the APIs have positive unit economics?
English
72
1
216
62.8K