Keith Wynroe

2.4K posts

Keith Wynroe

Keith Wynroe

@keithwynroe

Haikus available upon request

Katılım Temmuz 2019
291 Takip Edilen489 Takipçiler
Charles🔸
Charles🔸@CharlesD353·
I am excited to say I'm joining @gleech at @ArbResearch! Arb and Gavin have done some very cool projects over the years, and I am very keen to get stuck in and contribute. If you are interested in working with us, email charles at arbresearch.com
Charles🔸@CharlesD353

Personal news: I'm leaving my current startup role, looking to figure out what's next. I'm interested in making AI go well, and open to a variety of options for doing so. I have 10+ years of quant research and technical management experience, based in London. DM if interested.

English
10
4
124
9.3K
Keith Wynroe
Keith Wynroe@keithwynroe·
@norvid_studies Depressed cos I can't afford the new YayDay™ Deluxe Expansion Pack and my friends are running around laughing at stuff I can't see
English
0
1
1
118
Keith Wynroe
Keith Wynroe@keithwynroe·
@aaaronson Enjoying being part of whatever journey you’re on here man
English
0
0
2
490
Adam Aaronson
Adam Aaronson@aaaronson·
Longest word with only n different letters
Adam Aaronson tweet media
English
40
188
9.5K
435.4K
Keith Wynroe
Keith Wynroe@keithwynroe·
@andyarditi @StephenLCasper @GoodfireAI So you can probably identify a "fragment length" feature quite easily but I'm guessing also pull that out of the original dataset quite easily too. If the SAE found some super esoteric feature combining a bunch of things you'd never think of that'd be great but then...
English
1
0
1
69
Cas (Stephen Casper)
Cas (Stephen Casper)@StephenLCasper·
@GoodfireAI, I think this hype-milling verges on dishonesty. I believe that this paper has the potential to do big disservice to its readers, particularly less experienced ones who are newer to interp. Nothing new was accomplished here, and it wasn’t done in a useful way. This project just used interpretability methods as a circuitous way of contriving the rediscovery of predictive features in data sets, like sequence length. This project validated its interpretations about the salience of features by validating them as predictive features within a test set. But if that is what we treat as the ground truth, there’s no point to the use of interp tools. This is not a proof of concept for a repeatable recipe for scientific discovery as the post and thread claim. In order to show that these tools are valuable, you need to show that you can use them to discover something that wouldn’t be trivial to discover just by looking at the datasets. In the past few years, several papers have demoed this kind of thing. But this paper is not one of them. When you limit yourself to a hammer, everything looks like a nail. Especially when you’re also selling that hammer. In 2023, I told the GoodFire founder that I think a venture-capital-backed, for-profit interpretability research startup was the last thing that the epistemics of the interpretability community needs. I think this is still true and that GoodFire is establishing a pattern of grift.
Goodfire@GoodfireAI

We've identified a novel class of biomarkers for Alzheimer's detection - using interpretability - with @PrimaMente. How we did it, and how interpretability can power scientific discovery in the age of digital biology: (1/6)

English
10
2
158
21.4K
Keith Wynroe
Keith Wynroe@keithwynroe·
@andyarditi @StephenLCasper @GoodfireAI I think it's a bit unfair because you don't just learn that the feature is relevant you ideally learn how, and also auto-interp might answer some of this. But I think there's a fair criticism in there that it sort of kicks the can down the road a bit
English
0
0
0
36
Keith Wynroe
Keith Wynroe@keithwynroe·
@andyarditi @StephenLCasper @GoodfireAI Steelman-ing I think the argument is that classifying the SAE feature for e.g. methylation is bringing back in most of the work. You need to think of this as a hypothesis and then validate it, in which case why not look at the effect of methylation in the original dataset
English
2
0
2
146
Keith Wynroe
Keith Wynroe@keithwynroe·
@littmath @probnstat Wait that’s your actual job? I thought it was a side hustle from the coin puzzle thing
English
0
0
3
124
Probability and Statistics
Probability and Statistics@probnstat·
Daniel Litt is a leading modern mathematician whose work lies at the intersection of algebraic geometry, number theory, and topology, especially in the study of cohomology, arithmetic geometry, and the geometry of moduli spaces. He has made influential contributions to understanding how geometric objects defined over different fields behave, including breakthroughs on the topology of algebraic varieties, p-adic Hodge theory, and étale cohomology. Litt is particularly known for developing powerful new tools that relate the shape of geometric spaces to arithmetic information, helping resolve long-standing conjectures about how algebraic equations encode hidden symmetries. These ideas now influence areas beyond pure mathematics, including cryptography, coding theory, and even theoretical aspects of machine learning that rely on algebraic and geometric structure. By revealing deep links between geometry and arithmetic, Litt’s work pushes forward our understanding of symmetry, space, and computation at the most fundamental level. @littmath
Probability and Statistics tweet media
English
9
29
318
25.1K
Keith Wynroe
Keith Wynroe@keithwynroe·
@norvid_studies @GuiveAssadi @robinhanson Alternatively you can read it as suggesting two rounds of discrimination one drunk one sober which is wasteful since you expect the drunk discrimination to be mostly redundant
English
0
0
1
29
Keith Wynroe
Keith Wynroe@keithwynroe·
@norvid_studies @GuiveAssadi @robinhanson I think this one sounds pointless because it sounds agnostic to order/treats the states as interchangeable instead of a fixed generator-discriminator pair E.g would be terrible to come up with ideas sober then debate them drunk but this doesn’t care
English
1
0
1
43
Keith Wynroe
Keith Wynroe@keithwynroe·
@norvid_studies @GuiveAssadi @robinhanson “Write drunk, edit sober” is a pretty popular phrase so idk how tiny the corner cases are, I guess if you squint at it you can justify “loosen inhibitions to cast a wider net, filter when you’re more discerning”
English
1
0
2
46
Keith Wynroe
Keith Wynroe@keithwynroe·
@ejjiott small EV is infinite, big EV is $1m right? Prob of surviving k rounds looks like harmonic series for small but decays quadratically for big so it converges
English
0
0
1
51
E J T
E J T@ejjiott·
Here's a game.
E J T tweet mediaE J T tweet media
English
4
0
4
3.3K
Keith Wynroe
Keith Wynroe@keithwynroe·
@norvid_studies sorry I’m not free later I’m meeting at the palace in Bolivar to pick up my vial of ice-nine from the Hoenikker kids
English
0
0
1
44
Daniel Litt
Daniel Litt@littmath·
@RuxandraTeslo What's my biggest flaw? I have too many to name. The journals I publish in are too prestigious; my results are too strong; my accomplishments are too great for my colleagues to contain their envy. Truly I am a wretch.
English
6
3
152
3.9K