Stephan Verveen 💬

34.1K posts

Stephan Verveen 💬 banner
Stephan Verveen 💬

Stephan Verveen 💬

@OpenDictator

Who’s to say? / Wie mag het zeggen?

Utrecht, the Netherlands Katılım Haziran 2007
2.1K Takip Edilen1.8K Takipçiler
Stephan Verveen 💬 retweetledi
AukeHoekstra
AukeHoekstra@AukeHoekstra·
So THAT is why the AI from Anthropic is called Claude.
Tech with Mak@techNmak

In 1948, a 32-year-old at Bell Labs published a paper nobody fully understood. Engineers found it too mathematical. Mathematicians found it too engineering-focused. One prominent mathematician reviewed it negatively. That paper - "A Mathematical Theory of Communication", became the founding document of the digital age. The man was Claude Shannon. Father of Information Theory. At 21, he wrote the most important master's thesis of the 20th century. Working at MIT on an early mechanical computer, Shannon noticed its relay switches had exactly two states - open or closed. He had just taken a philosophy course introducing Boolean algebra, which also operated on two values: true and false. Nobody had ever connected these two things. His 1937 thesis proved that Boolean algebra and electrical circuits are mathematically identical, and that any logical operation could be built from simple switches. Howard Gardner called it "possibly the most important, and also the most famous, master's thesis of the century." Every digital computer ever built traces back to this insight. At 29, he proved that perfect encryption exists. During WWII, Shannon worked on classified cryptography at Bell Labs. His work contributed to SIGSALY, the secure voice system used for confidential communications between Roosevelt and Churchill. In a classified 1945 memorandum, he mathematically proved the one-time pad provides perfect secrecy, unbreakable not just computationally, but provably, permanently, against an adversary with infinite power. When declassified in 1949, it transformed cryptography from an art into a science. It laid the foundations for DES, AES, and every modern encryption standard. At 32, he defined what information is. His 1948 paper introduced one equation: H = −Σ p(x) log p(x) Shannon entropy. The average uncertainty in a probability distribution. The minimum bits required to encode a message. Three things followed: > He defined the bit - the fundamental unit of all information. His colleague John Tukey coined the name. > He proved the channel capacity theorem, every communication channel has a maximum rate of reliable transmission. You can approach it. You can never exceed it. > He unified telegraph, telephone, and radio into a single mathematical framework for the first time. Robert Lucky of Bell Labs called it the greatest work "in the annals of technological thought." Where his equation lives in AI today: Cross-entropy loss - the function training every classifier and language model, is derived directly from H. Decision tree splits use information gain, which is H applied to data. Perplexity, the standard LLM evaluation metric, is an exponentiation of cross-entropy. Every time a neural network trains, Shannon's formula runs inside it. He also built the first AI learning device. In 1950, Shannon built Theseus, a mechanical mouse that navigated a maze through trial and error, learned the correct path, and repeated it perfectly. Mazin Gilbert of Bell Labs said: "Theseus inspired the whole field of AI." That same year he published the first paper on programming a computer to play chess. He co-organized the 1956 Dartmouth Workshop, the founding event of AI as a field. The man: He rode a unicycle through Bell Labs hallways while juggling. He built a flame-throwing trumpet, a rocket-powered Frisbee, and Styrofoam shoes to walk on the lake behind his house. He called his home Entropy House. When asked what motivated him: "I was motivated by curiosity. Never by the desire for financial gain. I just wondered how things were put together." In 1985, he appeared unexpectedly at a conference in Brighton. The crowd mobbed him for autographs. Persuaded to speak at the banquet, he talked briefly, then pulled three balls from his pockets and juggled instead. One engineer said: "It was as if Newton had showed up at a physics conference." He died in 2001 after a decade with Alzheimer's, the cruel irony of information slowly leaving the mind of the man who defined what information was. Claude, the AI model, is named after Claude Shannon, the mathematician who laid the foundation for the digital world we rely on today.

English
4
12
56
8.1K
Stephan Verveen 💬 retweetledi
Harry Eccles
Harry Eccles@Heccles94·
Can we get this shared 10,000 times? "War crimes don't hide sex crimes!"
English
112
6.5K
12.2K
101.2K
Stephan Verveen 💬 retweetledi
Eivor
Eivor@Eivor_Koy·
Meanwhile in China, the viral White House prayer scene has turned into a full-blown social media trend. Bosses at small businesses and factories are rounding up their employees to make fun of the stunt—forming a circle, placing hands on shoulders or heads, and praying in a humorous way for “better sales, higher incomes for every worker and the whole company.” Videos of these “prayer circles” are blowing up on Douyin and Weibo. Not sure how much divine favor the White House actually summoned, but these Chinese bosses? They straight-up turned the Oval Office prayer stunt into free global marketing gold🤣
Eivor tweet mediaEivor tweet mediaEivor tweet media
euronews@euronews

Faith leaders gathered in the Oval Office to pray over President Trump — captured in a video released by a Trump adviser.

English
696
13K
63.2K
2.8M
Stephan Verveen 💬 retweetledi
Bernie Sanders
Bernie Sanders@BernieSanders·
One family, the right-wing Trump-aligned Ellisons, will soon control: TikTok CBS CNN HBO Discovery Channel BET Cartoon Network Comedy Central DC Studios Fandango Miramax MTV Nickelodeon Paramount PlutoTV Showtime TBS The CW TNT Warner Bros. And more This is oligarchy.
English
23.7K
45.8K
188.9K
5M
Stephan Verveen 💬 retweetledi
🌿 lithos
🌿 lithos@lithos_graphein·
EUV Source Power Roadmap.
English
4
1
46
3.1K
Stephan Verveen 💬 retweetledi
Roy E. Bahat
Roy E. Bahat@roybahat·
Outside Anthropic's office in SF... intense moment!
English
491
4.9K
33.6K
1.9M
Stephan Verveen 💬 retweetledi
ASML
ASML@ASMLcompany·
Billions of transistors with features just nanometers wide power today’s most advanced devices – and our extreme ultraviolet (EUV) lithography tech makes these nanoscale features a reality.
English
34
158
1.4K
110.2K
Stephan Verveen 💬
Stephan Verveen 💬@OpenDictator·
Listening to this is time well spant
Dwarkesh Patel@dwarkesh_sp

New episode w @AdamMarblestone on what the brain's secret sauce is: how do we learn so much from so little? Also, the answer to Ilya’s question: how does the genome encode desires for high level concepts that are only seen during lifetime? Turns out, they’re deeply connected questions. Timestamps 0:00:00 – The brain’s secret sauce is the reward functions, not the architecture 0:22:20 – What the genome actually encodes 0:42:42 – What kind of RL is the brain doing? 0:50:31 – Is biological hardware a limitation or an advantage? 1:03:59 – Why we need to map the human brain 1:23:28 – What value will automating math have? 1:38:18 – Architecture of the brain Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

English
1
0
0
85
Stephan Verveen 💬 retweetledi
Stephan Verveen 💬 retweetledi
Keith Edwards
Keith Edwards@keithedwards·
The concept of putting a medal on yourself
Keith Edwards tweet media
English
1.1K
4K
55.6K
768.9K
Stephan Verveen 💬 retweetledi
Massimo
Massimo@Rainmaker1973·
Resonant frequency demonstration
English
62
1.4K
17.2K
1.9M
Stephan Verveen 💬 retweetledi
Tessa Barton
Tessa Barton@tessybarton·
I can't believe I am saying this, but Rich Sutton is looking dripped out
Dwarkesh Patel@dwarkesh_sp

.@RichardSSutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI

English
16
14
608
99.7K
Stephan Verveen 💬 retweetledi
ASML
ASML@ASMLcompany·
We just announced a strategic partnership with Mistral AI, with the goal to enhance our products and solutions for the benefit of our global customer base. Learn more: ms.spr.ly/6014s90ha
ASML tweet media
English
75
209
1.7K
103.7K
Stephan Verveen 💬 retweetledi
Carole Cadwalladr
Carole Cadwalladr@carolecadwalla·
NEW: Landmark decision on UK's failure to investigate Russian interference to be handed down tomorrow. A five-year legal battle in UK and European courts comes to a head: will we finally - learn the truth about the Kremlin & the Brexit vote?
Carole Cadwalladr tweet media
English
165
1.5K
4K
366K
Stephan Verveen 💬 retweetledi
The AI Investor
The AI Investor@The_AI_Investor·
If you still don't get Nvidia and the AI opportunity, watch this 10 times. This was from January 2024, and it's becoming even more obvious now, Jensen is a true visionary. $NVDA
English
43
144
842
74.6K