
Andrew Chang
173 posts

Andrew Chang
@achang1618
Building @runalph My knowledge graphs @neode_ai




So, I asked every AI model if this was true Then I checked Wikipedia Then I asked AI researcher ppl I knew to be sure And not a single source confirms that you created the first LLM You had a massive impact creating the ULMFiT algorithm which pioneered transfer learning and fine-tuning techniques though Happy to be corrected if you did create the first LLM, of course, but I can't find the sources anywhere



CONFIRMED: China built and has brought to full power the world's first-ever thorium-containing molten salt reactor, the TMSR-LF1. Initial criticality occurred on Oct 11, 2023. Full power on June 17, 2024. Pa-233 from thorium was detected Oct 8, 2024. It's the first MSR to run since the US shut down its MSRE in 1969, which ran on enriched U-235 and then later on thorium-derived U-233. Commercial-scale thorium-fueled reactors have run in the past, (Indian Point 1, Shippingport, THTR), but this is the first MSR to do so. (I had heard rumors that it ran already but haven't seen it confirmed until now)








Yes, I've made this point many times. The beginning of a sigmoid looks like an exponential. Not only can we "never be fully certain that what we are observing isn't in fact following a logistic trend before the inflection point", we can always be fully certain that *every* *single* *exponential* *trend* eventually passes an inflection point and saturates into a sigmoid. Continuing an exponential trend beyond that inflection point requires a paradigm shift. No physical process can grow indefinitely. There are always friction terms in the dynamics equation that eventually become dominant (energy consumption, heat dissipation, quantum effects, thermal fluctuations, communication bandwidth, mass/energy density....). Even processes that *appear* exponential on a long time scale are actually a succession of sigmoids, in which each new sigmoid is caused by a paradigm shift. A good example is Moore's Law. It is saturating right now. But the exponential progress of the last 7 decades is due to a succession of technological paradigm shifts that weren't pre-ordained. Each paradigm behaved like a sigmoid. Each new sigmoid overtook the previous one. The envelope turned out to be exponential. We haven't seen similar paradigm shifts in, say, airplane speed or space travel. Technological paradigm shifts require scientific breakthroughs.



Fun, possibly mind-boggling fact that Sam Altman knows that you might not, h/t @ihorgowda: Altman and Oppenheimer share a birthday, April 22.










1/ I’d like to share a fun little demo we have been hacking on @golden We attempt to answer factual questions in a more accurate way using the Golden Knowledge Graph by providing a retrieval enhancement to GPT-3. Golden Retriever: ai.golden.com Thread👇



