@pinecone I just sent you an email at support@pinecone.io with subject line "Pinecone and searchthearxiv.com." I'd appreciate a non-bot response. Thank you 🙏
English
August Wester
432 posts
August Wester
@augustwester
ML research & engineering at @veotechnologies. I like deep learning, and I occasionally blog about it on https://t.co/Nt7ezYxQ6Q.
Copenhagen Katılım Mart 2009
90 Takip Edilen232 Takipçiler
Nice to see @demishassabis reading @DavidDeutschOxf in the new trailer for "The Thinking Game" 😄 youtu.be/J5XFYMsczy8?si…
YouTube
English
Celebrating the Nobel Laureates and the AlphaFold team, October 9, 2024
English
Finally had some spare time to push a much needed update to Sidekick: It now supports GPT-4 as well as the new GPT-4o. You can switch between them (as well as GPT-3.5) in settings. sidekiiick.com
English
@MLStreetTalk You guys should speak with @DavidDeutschOxf. He makes more sense than anyone else I've heard on this topic. If you can get @yudapearl to join in, it would be a true meeting of the minds 😄
English
TL;DR - deep learning folks still think prediction == understanding. They are still wrong 😂
Judea Pearl@yudapearl
This is precisely what statisticians used to say. "If you can predict well the next data point, they you understand the reality or the process that generates that point". They said it and said it until Causal Inference proved them wrong. Understanding takes more than prediction. #Bookofwhy
English
August Wester retweetledi
Today we are announcing a major breakthrough in the Vesuvius Challenge: we have read the first word from an unopened Herculaneum scroll.
The word is "πορφυρας" which means "purple dye" or "cloths of purple."
scrollprize.org/firstletters
Congratulations to 21yo computer science student @LukeFarritor who is the first person to see this handwriting in nearly 2000 years. He has won the $40,000 First Letters prize for this world-historical achievement.
We are also awarding a $10,000 First Ink prize to @CJHandmer who was the first person to see ink and multiple letters within an unopened scroll. His work was the basis of Luke's ML model.
And @Youssef_M_Nader has won a $10,000 second-place First Letters prize for producing the clearest and most comprehensive images from inside a scroll yet.
This has been the dream of many people since the scrolls were first discovered in the 1750s. It is also the result of 20 years of work from Dr. Brent Seales and his team at EduceLab, whose years of dedicated work have made this last mile possible.
The $700,000 Vesuvius Challenge Grand Prize is now in sight. Who will claim it?
English
searchthearxiv.com just hit 300,000 ML papers, all searchable using natural language thanks to @pinecone.
English
@fermatslibrary Maybe the best description of universality I've come across. /cc @DavidDeutschOxf
English
Philosopher and linguist Wilhelm von Humboldt on language
English
@boredyannlecun @mmbronstein "and let P and R denote other symbols" 😂
English
@alexhdezgcia @folinoid GFlowNets are very interesting! If anyone wants a primer, I wrote this late last year. sigmoidprime.com/post/gflownets/
English
I am sadly not in Hawaii at #ICML2023 but if you are interested in learning about GFlowNets I can totally recommend you go talk to my co-authors there at the poster sessions today!
- A theory of continuous generative flow networks (11 am now!)
- Multi-Objective GFlowNets (2 pm)
English
This all sounds like a stark violation of the most fundamental theorem of causal inference. Do you agree, @yudapearl?
Alex Ker 🔭@thealexker
Does GPT understand the world? Here is what @ilyasut, co-founder of OpenAI, says during a discussion with Jensen Huang, CEO of Nvidia: (1) When we train a large neural network to accurately predict the next word in lots of different texts from the internet, the AI is learning a world model. (2) On the surface, it may look like learning correlations in text, but it turns out that to 'just learn' statistical correlations in text, to compress information really well, what the neural network learns is some representation of the process that produced the text. (3) This text is a projection of the world...what the neural network is learning is aspects of the world, of people, of the human conditions, their hopes, dreams, motivations, their interactions...the situations we are in. The neural network learns a compressed, abstract, usable representation." Do you think learning representations = understanding? Are large language models simply stochastic parrots, or are they much more?
English
@rveulacia @techwraith @IamtheWay13 @tshddx @Sam070770 @arvandhassan @DavidDeutschOxf @kmett Yes, when serving as a stepping stone to the concept of explanatory universality. Computational universality is a property of hardware, *including* the computers running the LLMs. CU is a necessary but not a sufficient condition for AGI (in case anyone is wondering).
English
@techwraith @IamtheWay13 @tshddx @Sam070770 @arvandhassan @DavidDeutschOxf @kmett The only way to understand how Deutsch thinks of us being unconstrained thinkers is to first grasp the key notion of computational universality.
English
Douglas Hofstadter on the rate of AI progress and his collapsing belief system.
youtube.com/watch?v=lfXxzA…
YouTube
English
This paper by @mpshanahan is a breath of fresh air in the usual doomsday talk. It reminds me of this quote from Hamming, which seems more relevant than ever. arxiv.org/abs/2212.03551
English
@pfau @mmbronstein @ToKTeacher You might find this one worth a watch (for the fun of it, if nothing else) 🙂
English
@pfau @mmbronstein It's interesting how proponents of the precautionary principle tend to frame their arguments in terms of bogus probabilities and appeals to authority rather than good explanations. This was vividly on display in the Munk debate. youtube.com/watch?v=144uOf…
YouTube
English
We cannot rule out the possibility that radio communication will alert hostile alien superintelligences to our whereabouts, triggering an invasion posing an existential risk to humanity. Therefore we must carefully regulate radio technology until we have better planetary defenses
English
If you're interested in GNNs, @PetarV_93's "Everything is Connected" survey paper is a great primer. arxiv.org/abs/2301.08210
English