Lara Mohan

update: my sister just got accepted to berkeley math, class of 2030 LFG congrats @lara_mohan!!!

gifted my high school sister chatgpt pro for christmas in the last couple hours she went from 0 to legit results on an interp project exploring emergence of position dependent neurons in rnns trained for path integration (she’s interested in entorhinal grid cells)

will be visiting stanford tmrw with my sister who's working on some multimodal interp stuff to watch @thebasepoint's talk at CS25 hmu if you wanna catch up or chat abt interp & architecture!

my 16 year old sister just called me from a hackathon asking whether she should use fact injection or fewshot prompting for an LLM project she’s hacking out today proud big bro moment 🥹😭🥰

Algorithms like MEMIT enable us to inject facts into an LLM by editing its parameters 💉🧠. Could we use fact editing to crowdsource a continually updated neural knowledge base—with no RAG or external documents? Announcing WikiLLM! Tomorrow's [experimental] free encyclopedia 🧵

my 9th grade sister debriefing her first hackathon: