Kip Kaehler

140 posts

Kip Kaehler banner
Kip Kaehler

Kip Kaehler

@KipKaehler

Habitual line stepper.

San Francisco Katılım Aralık 2011
469 Takip Edilen93 Takipçiler
Kip Kaehler
Kip Kaehler@KipKaehler·
@emollick Isn’t this debate irrelevant? They’ve proven that MLA+MOE+RL w/o proprietary training sets outperform at trivial cost. Those ideas are everyone’s to take now, nobody needs to use the actual weights when training is this cheap. If not deepseek, everyone will use some derivative.
English
1
0
1
251
Ethan Mollick
Ethan Mollick@emollick·
I think a lot of people on this site underestimate the suspicion with which General Counsel’s offices already view LLMs. I bet that there will be a reluctance in US firms to adopt or use DeepSeek even if it is the best open, local model as they are worried about unspecified risks
English
55
26
482
91.8K
Kip Kaehler
Kip Kaehler@KipKaehler·
@lessin Challenge with the “Money” approach is that you will attract the worst candidates (terrible but interview well or prestige backgrounds) and you have to be excellent at spotting the difference. With mission/misfits you have an advantage of high signal to noise
English
0
0
0
72
sam lessin 🏴‍☠️
3Ms To Getting the Real Talent On Your Team (Mission, Misfits, Money)
sam lessin 🏴‍☠️ tweet media
English
5
4
71
11.7K
Kip Kaehler
Kip Kaehler@KipKaehler·
@patio11 Awesome! Please share where you read/saw/heard this
English
0
0
0
281
Patrick McKenzie
Patrick McKenzie@patio11·
Because, if your e.g. county won the geographic lottery, your landowning class (who have substantial political heft, always) have all just become very substantially richer *if and only if* polity can be convinced to allow fracking. So they organize to ensure that happens.
English
8
13
520
51.9K
Patrick McKenzie
Patrick McKenzie@patio11·
I learned a bit about fracking today and even relative to my prior expectation holy cow does it sound like sorcery. As one example of many, how do you think they get information from bottom of the well to top of the well while drilling?
English
80
267
2.4K
814.2K
Kip Kaehler
Kip Kaehler@KipKaehler·
@goodside I mean...Not surprising? They tested OOD using Swahili/Filipino/etc while the multilingual models used here were trained on datasets (wikipedia for mbert) with <0.1% representation of those languages.
English
0
0
6
757
Riley Goodside
Riley Goodside@goodside·
this is wild — kNN using a gzip-based distance metric outperforms BERT and other neural methods for OOD sentence classification intuition: 2 texts similar if cat-ing one to the other barely increases gzip size no training, no tuning, no params — this is the entire algorithm:
Riley Goodside tweet media
Luke Gessler@LukeGessler

this paper's nuts. for sentence classification on out-of-domain datasets, all neural (Transformer or not) approaches lose to good old kNN on representations generated by.... gzip aclanthology.org/2023.findings-…

English
134
1.1K
7K
2.1M
Kip Kaehler
Kip Kaehler@KipKaehler·
@Broncho24 Richard Rodes “Energy” is much more of a general history than most of those above going from wood to nuclear with a lot of context around each transformation.
English
0
0
1
147
Kip Kaehler
Kip Kaehler@KipKaehler·
@headphoneDas Had the reverse experience with my kids listening to the lion king. “Wait…is this the gladiator guy”. That guy does everything! Dad lives everyone dies, dad dies everyone else lives, he can score it all
English
1
0
1
47
Anshu Das
Anshu Das@headphoneDas·
Listening to the gladiator soundtrack and of COURSE this was Hans Zimmer. GOAT
English
1
0
4
535
Kip Kaehler
Kip Kaehler@KipKaehler·
@ricburton I'm also of the opinion they should send you a tote bag
English
1
0
4
476
Kip Kaehler
Kip Kaehler@KipKaehler·
@parkerconrad @natfriedman @OpenAI +1! From the self-censored examples it seems they might have a secondary model (or separate model head) that detects offense and then produces a stock response - or - a smaller model generates a trained response. Stable diffusion does something similar (but nulls the output)
English
2
0
4
0
Parker Conrad
Parker Conrad@parkerconrad·
@natfriedman I would really love to understand how @OpenAI trained the model to be inoffensive. Would be fascinating to understand what went into that.
English
1
2
34
0
Nat Friedman
Nat Friedman@natfriedman·
These models that have been trained never to offend the most shrill parts of society are going to be like living with an HR person monitoring your every move. The iron prison, in every corner of your life. Hell on earth.
English
99
313
3.3K
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@CJHandmer I thought it was pretty fair. He was kind to many of the early projects like Owens Valley (from a water use standpoint at least) and Hoover. He just let it rip on the later projects that were just keeping engineers busy at otherwise negative net value
English
0
0
0
0
Casey Handmer
Casey Handmer@CJHandmer·
The book is a fascinating historical account but, to me, seems built on shaky premises. An increasingly strident bias as the chapters progress favoring degrowth and rewilding of the west. Not without cost but the BoR and friends really did terraform half a continent.
English
3
0
1
0
Casey Handmer
Casey Handmer@CJHandmer·
Finally reading "Cadillac Desert" and I've never felt so scolded in my life!
English
5
0
7
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@hkarthik Let’s be careful here - you and I can’t both be top 25% in our org! Rather than working too hard, we should pull straws to decide who survives
English
0
0
7
0
Karthik Hariharan
Karthik Hariharan@hkarthik·
This is my third recession in tech, here's my playbook: 1. Cut spending. Put off vacations, auto, and home purchases. Have 12 months of emergency savings. 2. Put in more effort at work to reach the top 25% of performance. 3. Learn more marketable skills with your extra time.
English
92
682
5.9K
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@TerraformIndies Since it’s opex dependent does profitability mean the machines only run during cheap daylight hours?
English
1
0
0
0
Terraform Industries
Terraform Industries@TerraformIndies·
@KipKaehler Each fits on a single flatbed for deployment on skids. Manufactured, deployment involves dropping on the ground, connecting a few plugs and hoses, then walking away.
English
2
0
3
0
Terraform Industries
Terraform Industries@TerraformIndies·
We had a great conversation with a candidate on site at the Terraform Industries castle this morning. One of the key takeaways is that, during the design phase, we have considerable freedom to choose where we put the hard part.
English
1
0
22
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@TerraformIndies Whats the size/capacity of each machine? Are we talking manufacturing or construction for each deployment?
English
1
0
0
0
Terraform Industries
Terraform Industries@TerraformIndies·
Building millions of them. It's not enough to make a shiny prototype or proof of concept. We can be profitable with 1000 machines in operation and extremely wealthy with a million. But we won't make a dent in the climate problem with less than 100 million machines.
English
2
0
7
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@JayNDonde I agree with your point on unclear goals. We seem to aim to increase the mean education level but I think society is better served if we split resources b/w the 25th percentile (foundational skills for all) and 99th (more Nobel prize winners). Average is a waste for most topics
English
0
0
0
0
Jay Donde
Jay Donde@JayNDonde·
Most education reform efforts focus on improving student outcomes along existing metrics, but you don't see too much discussion of whether those metrics themselves have value. What would a 21st century high school curriculum look like if we built it from scratch? 🧵
English
1
0
4
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@matt_levine @patio11 @tqbf You need to take this opportunity to write our generation’s Barbarians at the Gate. Something about an electric clown car
GIF
English
0
0
0
0
Matt Levine
Matt Levine@matt_levine·
@patio11 @tqbf i definitely tell people that elon will put my kids through college
English
4
4
114
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@albrgr The Making of the Atomic Bomb is such an incredible combination of history and science (and the history of the science). Very under rated. If you liked it Dark Sun is an awesome follow up on the science while American Prometheus is a great afterword on the politics.
English
0
0
0
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@pt @rsg Ive always thought taxes should have some gift comparable to a NPR fundraising campaign. Would be cool to see billionaires flex 💪🏽 by pulling out their IRS umbrella
English
1
0
2
0
parker
parker@pt·
@rsg I was looking at the IRS payment site and to be fair if you owe more than $100M they do have some special services. My personal feeing is you should get a free t-shirt for every federal employee your taxes cover that you can wear to display your economic patriotism.
English
1
0
6
0
Bobby Goodlatte
Bobby Goodlatte@rsg·
If you pay $11 billion in taxes you shouldn’t be demonized by elected officials They should at least send you a free t-shirt or something
English
35
37
844
0
Kip Kaehler
Kip Kaehler@KipKaehler·
@kaehler1920 @typesfast Tax meat to lower demand/cost for grains, suspend the tax for Ukrainian livestock so they can convert their wheat->meat and march it across the land border.
English
1
0
1
0
Ben Kaehler
Ben Kaehler@kaehler1920·
@typesfast Good point... Are the land adjacent countries dependent on port for delivery? Those ones seem to be the highest % of 🇷🇺 wheat. Definitely scary for the African countries that are reliant on both. I'm sure this is in Putin's calculus for how to lift some sanctions.
English
2
0
3
0
Ryan Petersen
Ryan Petersen@typesfast·
Russian and Ukrainian grain won't make it to market this year. And with fertilizer prices surging, many farmers are scaling back production. What can be done to avoid food shortages around the world? Post your best ideas that don't require acts of congress.
Ryan Petersen tweet media
English
303
258
1.5K
0