Robin Goins
2.5K posts
Robin Goins
@coponder
Applied Phenomenology & Metacognition | also, events @ https://t.co/QhVsBFg8iI
Bay Area, CA Katılım Mart 2016
392 Takip Edilen410 Takipçiler
Is anyone interested in an X group for intellectually serious adults—professors, researchers, writers, professionals, independent scholars, etc? No politics, just a circle of rhinkers interested in each other’s posts. All interactions guided by the highest courtesy.
English
@leedsharkey Would you have any interest in giving a talk next month at Mox (moxsf.com) on VPD? (Timing flexible though.)
(Already coordinating with Thomas Fel re: a talk on neural geometry, would love to host the whole Goodfire lineup. :) )
Happy to DM w/ more details.
English
Read our blog post summarizing the work: goodfire.ai/research/vpd-e…
Full paper (including >20 interactive figures):
goodfire.ai/research/inter…
English
My team at @GoodfireAI has been cooking up a new way to do interpretability: decompose a language model’s weights, not its activations.
Our decomposition natively handles attention (!) and behaves less like a lookup table and more like a generalizing algorithm. (1/6)
English
@earnestpost @shaggysurvives Unfortunately, the string is touching your eye. 😔
English
@shaggysurvives I've been told 1 is sexy! Lol
English
POLL: which one of these 3 pictures would be the best for a dating profile?
English
@kageroumado @cube_flipper I'm with cubeflipper here, 1/8th of a tab is (always) extremely noticeable to me. I have been described as having high metacognition, tho.
English
You can try to have placebo on some days and the real one on others, then see the statistics. This could be genuinely interesting when done by someone with high metacognition, maybe the lab studies were simply wrong, or there’s something about individual differences we’re missing.
Personally, I didn’t feel anything from 20 mcg daily at all.
English
10 micrograms is not pharmacologically active, it’s homeopathy territory
Tao Lin@tao_lin
I recommend 10-25 micrograms LSD for relieving autism symptoms.
English
@etirabys Oh… the way the UI presented the options made me think you were only asking about black/white (which were the only ones I could see). Would’ve picked Navy actually!
English
@frankniujc @fnruji316625 @akatief48 On the off-chance @akatief48 or you will be in SF this June/July/August, we'd love for you to give a talk at Mox (moxsf.com) on this research!! Happy to DM with more details. :)
English
@fnruji316625 The real hero here is Federico @akatief48. Go follow him! What he is about to drop next is going to be HUGE!
English
A really interesting paper on representation geometry in LLMs written by my friend @frankniujc :
“Hypothesis-Driven Feature Manifold Analysis in LLMs via SMDS” proposes a model-agnostic way to test geometric hypotheses about latent representations instead of assuming everything is just linear directions. They find that different concepts naturally form different structures like circles, lines, clusters, and that these manifolds remain surprisingly stable across model families/sizes while also dynamically reshaping with context. Very cool bridge between mechanistic interpretability and representation geometry. 🔥
Especially liked the framing that reasoning may operate over structured manifolds rather than isolated features.
Paper: openreview.net/pdf?id=vCKZ40Y…
Code: github.com/UKPLab/tmlr202…
#LLM #MechanisticInterpretability #AIResearch #RepresentationLearning #TMLR #Interpretability #DeepLearning
English
@frances__lorenz Recommend also doing something like Function Health or Vitals Vault to check for any secret vitamin deficiencies that may be upstream of your being a depressed person
English
hi girlies and cutie pies I'm trying to achieve mental wellness and connect with nature!!! Wish me luck!!!! My goal is to be the type of person who doesn't understand depression and when people bring it up I'm just kind of like, "yeah uh, I don't really get that but good luck!"
English
Happy to share my first post since joining Goodfire.
Neural geometry has been my obsession for years, and our team here is building a really serious research agenda around it.
I can't wait to share the series of papers coming over the next few weeks...
Brace for shapes 🍩
Goodfire@GoodfireAI
Neural networks might speak English, but they think in shapes. Understanding their rich *neural geometry* is key to understanding how they work – and to debugging and controlling them with precision. Starting today, we’re releasing a series of posts on this research agenda. 🧵
English
@gworley3 @thechosenberg For example, for one person sex is only acceptable on the odd days of the month, and for the other sex is only acceptable on even days. They are a couple, they both want to have sex, but they can't
English
@etirabys Mox’s day pass is 9am-11pm (but no one will kick you out at 11, just the custom door code will not work anymore if you leave)
English
sth I crave as a parent is a day pass to a coworking space that gives 24h of consecutive access. my most free time for creative work is weekends, 12-4pm and 8pm-12am
there's one 24/7 space near me, but the 24/7 is only for full members. day pass gets you 9am-5pm weekdays
English
@EsotericHustler I think those are angel wings and not boobs
English
Opus 4.7 made this educational video for how Claudes are made
English
@2ang7 @ryxcommar This is the kind of answer I'd anticipate from someone who's primarily encountered the word in the context of purchasing/spending money on tokens, as opposed to someone who understands tokenizers or how LLMs work.
English
I've asked a couple candidates in interviews "what is a token" and I'm a little surprised how some people who have AI on their resume or in their title can't give a good answer. Like one person couldn't even give me a "it's a word" normie answer.
snoopy jpg@snoopy_dot_jpg
just interviewed a guy that has been working on llama4 evals at meta for the past year. i am not entirely convinced he understood what a token was. wild things happening over there
English
Drunk for the first time in a while, about 4 drinks so not crazy but still
I don't really like this, | like more energy and vitality and energy and attunement and this isn’t it
Also at a basic level I’m not actually experiencing positive valence
I must have a weird brain
English
@qorprate @anthonyronning I noticed it in the last week; in the thinking trace, it mentioned, "They're on mobile, so I should keep this short."
I've also saved a memory to override it, blech.
English
@anthonyronning luckily I can just ask Opus to override, and save a permanent memory. mainly curious when this started...
English
I saw someone recently arguing that large social events like protests are the way some people create strong, salient memories (those who don’t have or prefer a more private memory consolidation process, like keeping journals). Then the memories can act as fuel and a lens into the future, a sort of savepoint for personal integrity (or consistent patterning-in-time).
English
Can someone steel man me on what the purpose of a protest is?
What actually gets done besides having a cute viral moment or virtue signaling?
Marcel@illnevercallitx
That's it. That's the best picture from Saturday's No Kings protests in the USA. The literal Statue of Liberty being detained by police. It doesn't get much more poetic than this.
English
@arabelladevine In the first year or two of lyfts and ubers, I did that, not understanding the etiquette. :)
English
@arabelladevine Have you tried sitting in the front passenger seat?
English
idk what’s going on in sf but i’ve noticed the uber drivers here never want to talk to you. in portland about two thirds do, here it’s like one in ten. it kinda bums me out
Kai@kai_xbt
Threadguy reveals the real reason Waymo is going to take over the world "The real value of Waymo is not that it's cheaper. It's that you get in a Waymo and you don't have to talk to anybody. That is why Waymo is gonna take over the world and flip Uber. Nobody actually cares about the 10% discount or saving a little bit of money on gas." "They just don't want to talk to the guy who drives the Uber. And requesting a silent Uber is just a weird thing to do, you're like an asshole if you do that. I would rather walk than request a silent Uber honestly."
English