Asvin G

120 posts

Asvin G

Asvin G

@asving94

Katılım Eylül 2021
342 Takip Edilen81 Takipçiler
Asvin G
Asvin G@asving94·
@Jack_W_Lindsey This is a first step towards understanding how models conceptualize themselves and their agency. Speculatively, this capacity may be a building block for phenomena like awareness of being evaluated or undergoing training and forms of introspection and self-modeling capability.
English
1
1
9
256
Asvin G
Asvin G@asving94·
@Jack_W_Lindsey Interestingly, the information that flips the verdict lives entirely outside the subspace that represents entropy/surprise, indicating that implicit and expliciton-policy recognition use mechanistically distinct pathways.
English
1
1
8
310
Asvin G
Asvin G@asving94·
@Plinz Can you say more about how you disagree with that interpretation of godel? I can think of several stances you might take.
English
0
0
0
136
Joscha Bach
Joscha Bach@Plinz·
Natalie Wolchover has written another beautiful post about the difficulty of understanding Gödel's proof. It's worth reading, but also infuriating (a depressing number of her interviewees conclude that Gödel proves that math needs intuition etc.)
Quanta Magazine@QuantaMagazine

At age 25, Kurt Gödel proved there can never be a mathematical “theory of everything.” In this week’s Qualia column, @nattyover asks experts how his ideas changed the course of humanity’s unending search for truth. quantamagazine.org/what-do-godels…

English
16
10
145
22.3K
Asvin G
Asvin G@asving94·
@andyarditi Why do you say that this is *not* what is going on? Do you know that llama figures out the 5th month after October a different way than by rotating along the circle?
English
1
0
6
1.2K
Andy Arditi
Andy Arditi@andyarditi·
Why do language models represent the 12 months along a circle? A natural hypothesis is that this geometry is useful for computation - the model can compute "five months after October is _" by rotating around the circle mod 12. Turns out this is *not* what's going on (in Llama).
Sheridan Feucht@sheridan_feucht

Neural networks have beautiful feature geometry, but do they have mechanisms that actually interface with those structures? At @GoodfireAI this spring, we discovered one: a re-usable addition mechanism that reads/writes to Fourier features from prior work. 🧵

English
7
13
261
40.2K
Asvin G
Asvin G@asving94·
In order to completely automate mathematics, we need to automate both the process of finding explanations at a local level (proving theorems) as well as the process of discovering new frameworks to house these explanations. The second one is at least partially subjective!
English
1
0
0
66
Asvin G
Asvin G@asving94·
This ls discussion points at a deep question: what are we doing when we do mathematics? Taking it as a jumping off point for a view I have been developing. Brief tour, links at end.
jacob tsimerman@Jacob_Tsimerman

I want to clarify my thoughts on problem-solving in mathematics, and the potential consequences of AI for the field. For context, I’m quoting here my post in reply to Daniel Litt (who, echoing others, I find very clear, grounded, and insightful in his thinking). The claim The short version is that I think problem-solving is an immense, and pervasive part of modern mathematical research. Consequently, if human problem-solving disappears by virtue of the AIs becoming strictly and substantially better at it, then most of the time currently spent by modern mathematical researchers will have to be spent on an activity that is altogether pretty different. Whether such an activity is viable as a professional endeavour is something I am unsure of, but strongly encourage others to think about and try to envision, so that if/when the time comes, we can steer such a future into being. Allow me to make this somewhat concrete: by problem-solving I mean questions of the form “is T true? If so find a proof. If not, find a disproof.” where T is a precise mathematical statement. I’ll also include “find an example of S, if there is one” where S is some structure (variety/category/property/isomorphism/….). The argument Ok. Now as I said (and some have echoed) I spend ~all of my time problem-solving as my primary goal. This has sub-goals, but my entire main research field disappears if someone solves the Zilber-Pink Conjecture in its more general form. This is a single conjecture (precisely stated!) and lots of mathematicians, postdocs, and graduate students are engaged in picking apart special cases of it, trying strategies, finding analogies to develop intuition, etc.. Of course, lots of motivation and intuition and analogizing and understanding have gone into deciding to make the ZP conjecture a focus! But the fact remains that this is now what is being worked on ~all of the time by this community. This is true of many mathematicians. They have a problem (or ten) and spend most of their time doing it. If someone solves it, they have to find a different problem. This can be a big, disorienting process involving a lot of energy, and is neither trivial nor always fun (though often rewarding in the end). People have written a lot about Theory building vs. Problem-solving, and I want to first of all clarify I have nothing against theory building or theory builders! It is a valuable part of mathematics, and while there are differences in perspective between the “camps” there is way more mutual respect and agreement. However, I gather there is a perception that theory-builders spend most of their time not-problem-solving, and I think this is largely untrue. Now I’m not a theory-builder primarily (though I’ve partaken a LITTLE BIT by necessity) so I am outside of my comfort zone. As such, I apologize for mistakes and welcome corrections! But theory-building constantly runs through problem-solving. Let’s say you want to define the right notion of a cohomology theory. Of course you must make candidate definitions. But then what does it mean for it to be the right one? Well, you start asking if it has natural properties. These are T statements. Does it satisfy a Kunneth formula? Is it functorial in the right way? When you have the wrong one you have to find the properties it’s missing, and when you have the right one you have to prove that it indeed has those properties. Again, I am not saying nor do I believe that this makes problem-solving “real math” and theory-building lesser. I am just trying to draw attention to the way I think research mathematicians operate, and mathematics is practiced. To put all this a different way, imagine you had access to an AI oracle that could resolve statements T, but somehow lacked any creativity to build technology or make definitions (I think this is unlikely, but for the purpose of this thought experiment lets imagine it). How would your mathematics change, if you were a theory builder? Well, you make a definition, and want to know if it’s the right one. You immediately ask your oracle a thousand questions. From “are these basic properties true” to “ooh, so is this deep conjecture true?” and start getting back answers, and amending your definitions. You could invent and resolve entire research directions in days. But the confusion you would have had to push through to flesh out your theory would largely (probably not entirely) be instantly resolved and the whole process sped up tremendously by your oracle. A big part of the process would be gone. This is very very different to modern mathematics. One more thought This post is too long already, but I’ve seen some people say that they only do mathematics to find truth and others valourize that as the only virtuous way to be. I do not do mathematics only to find truth. I do it largely because I enjoy it and I am good at it. I also find it beautiful and am grateful I get to spend my days understanding beautiful things. But I enjoy the challenge, the process, resolving confusions, finding strategies, grappling with problems. I would like to push for this being de-stigmatized. Mathematicians are people who need money, housing, food, love, exercise, and a great deal of other stuff including various forms of meaning. There are many people whose primary enjoyment of math comes through problem solving in one of its incarnations. If that disappears, that is not a trivial issue and many of them might not want to do it anymore (even if there were some way to proceed).

English
1
0
1
153