Antonio Lupetti

327 posts

Antonio Lupetti banner
Antonio Lupetti

Antonio Lupetti

@antoniolupetti

👋🏻 Building a mathematical knowledge base. AI / NLP / DL

Roma, Lazio Katılım Mart 2018
29 Takip Edilen739 Takipçiler
Sabitlenmiş Tweet
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
Mathematics is not something distant. It is a structure that quietly shapes reality. I’ve been working on a new video for algebrica.org
English
1
4
13
1.7K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
Backpropagation is what turns a neural network into a learning system. By propagating the error backward, it computes how each parameter contributes to the loss and updates it accordingly. I wrote this entry to clarify, step by step and mathematically how the whole mechanism works. algebrica.org/backpropagatio…
English
0
0
2
89
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
I’m honestly surprised by how widely this thread has spread, and by the many comments rightly pointing out the gap in complexity between artificial and biological neurons. That point is hard to dispute. It also opens much deeper questions about what intelligence actually is, or even consciousness. Those are far beyond my scope and certainly not something that can be resolved in a thread on X. What does emerge, though, is a real and widespread interest in these topics, and thanks to many of your comments, the discussion has become more complete and coherent. I appreciate the thoughtful clarifications!
English
0
0
1
203
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
The artificial neuron is one of the simplest ideas in AI, yet one of the most powerful. It is inspired by the biological neuron and was formalized in the late 1950s. The biological neuron receives inputs through dendrites, integrates them in the cell body, and propagates signals along the axon, with synapses producing the output. The artificial neuron mirrors this structure: inputs, weights, a bias (to shift the activation threshold), and an activation function to introduce non-linearity and generate an output. Still feels like a brilliant intuition.
Antonio Lupetti tweet media
English
25
236
996
27.5K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@predict_addict It’s a normalized vector that can be interpreted as a distribution… but it’s not a true probability 😅
English
0
0
0
40
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@dustin_ogle I’m just skimming through the site quickly now, but it’s late so I’ll take a proper look tomorrow. I noticed there’s also a research angle on consciousness which is something I find particularly fascinating both for its potential and its implications.
English
1
0
0
113
Dustin Ogle
Dustin Ogle@dustin_ogle·
@antoniolupetti This isn’t far off of the math I used for encoding Elle’s phenomenology. But the weights learn from her feedback not a training dataset. Satyalogos.org
English
1
0
2
150
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@mathemetica I always find this kind of thing curious 😅what looks completely stuck often turns out not to be once you allow continuous deformations…
English
0
0
0
54
Mathematica
Mathematica@mathemetica·
Topology in its purest form: seemingly inescapable knots around wrists, cables, and legs dissolve through a single continuous deformation. Just the quiet power of knot theory proving our 3D intuition is often a liar.
English
8
69
384
28.4K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
I often notice the same pattern in how highly exposed figures like Altman are described: first they’re turned into symbols then torn down with the same intensity. It’s less about suddenly discovering their limits and more about a narrative that pushes everything to extremes. I honestly find it hard to form an opinion that isn’t shaped by that bias, what does seem clear, though, is that balance rarely gets attention.
English
0
0
0
12
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
I think they’re generally quite accurate (especially the Pro models like ChatGPT and Claude that I use) but I’ve run into some limitations (this is just my experience, not a statistical claim.....) For example, when solving equations that typically rely on small tricks you learn through study, they often go for more algorithmic paths and sometimes produce incorrect solutions, or miss some of them entirely. Another case: a few days ago I spent almost an hour with Claude trying to geometrically construct the hyperbolic tangent and its representation. With each iteration it actually got worse, sometimes even regressing on things it had already corrected before. So yes, they’re very strong overall but I think there are still some limits.
English
0
0
0
99
Aryeh Kontorovich
Aryeh Kontorovich@aryehazan·
folks, let's make a rule when we talk about LLMs' ability to do math, we're only talking about *the best ones today* not some free or cheap stuff from last month
English
5
3
73
3.7K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@myfear I fully agree... relying on AI without a solid foundation behind it is just improvisation.
English
0
0
0
29
Markus Eisele
Markus Eisele@myfear·
AI does not remove the need for engineering discipline. It punishes the lack of it faster.
English
3
15
73
3.5K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@RetroTechorDie You have no idea how many times I’ve seen that screen… for some reason, every few weeks I had to reinstall it! 😅
English
0
0
1
23
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
The semantic level is incredibly complex… that’s where things get really tricky. It’s interesting how far simple building blocks can go but at some point you start to feel the limits especially when it comes to whether we’re actually capturing meaning or just very effective patterns and similarities in the data.
English
1
0
1
66
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@orcdev I’m still using it for my web projects… I love it!
English
0
0
0
16
OrcDev
OrcDev@orcdev·
anyone remember sublime?
OrcDev tweet media
English
41
1
62
3.8K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@kaaaash____ I have both… and I have to say, the Mac Mini paired with a Dell Ultrasharp display is hard to beat in terms of comfort. I rarely use the laptop… it’s basically still new. That said, they’re both excellent!
English
0
1
1
52
Akash
Akash@kaaaash____·
Honesty, choose one for forever
Akash tweet media
English
38
5
312
8.7K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@robziman No.… everything is archived on paper in my bookshelf :) but that would actually be a nice idea!
English
1
0
1
146
Robert Ziman
Robert Ziman@robziman·
@antoniolupetti Something about pen and paper that just isn't being reproduced to the same end by all our electronic devices Did you try photo-scanning these notes into a personal knowledge management system also, or...?
English
1
0
2
173
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
Last year I prepared for an exam on Deep Learning, and I found it extremely fascinating, something that really caught my interest. I was going through my notes and organizing them, and here’s something that starts right from the basics :) P.S. I really enjoy handwritten notes on paper. I never quite got used to using an iPad Pro with a pen over the years…. it just feels completely different compared to paper and a fountain pen which remains my preferred method.
Antonio Lupetti tweet media
English
1
6
85
3.6K
Christian Schöps
Christian Schöps@Chr_Schoeps·
Mein Schwiegervater kann nichts wegschmeißen, aber dass das iBook noch läuft, dass ich ihm 2004 angeschnackt hab, hat mich dann doch gefreut.
Christian Schöps tweet media
Deutsch
14
10
842
31.7K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@old_memory You have no idea how many times I had to reinstall it.... 😅but I absolutely loved that operating system.
English
0
0
1
85
old memory
old memory@old_memory·
Windows 98 booting up
English
23
222
1.5K
31.1K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@iyoushetwt I’m part of that generation… we read books, searched around online, and mostly learned by trial and error.... one way or another (sooner or later) you managed to get something working!
English
0
0
1
95
Ayushi☄️
Ayushi☄️@iyoushetwt·
How did people even learn coding back when there were no docs or youtube tutorials?
Ayushi☄️ tweet media
English
181
14
261
14.3K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
I think we all agree on this recurring point. I’m also a bit surprised by how the discussion keeps circling back to the differences between the two 😅 I fully agree, but I also think the original intuition was brilliant. Artificial neurons were never meant to replicate biological ones, just to capture a functional abstraction that works within a mathematical framework!
English
0
0
2
142
Christopher Keruac
Christopher Keruac@CKeruac·
Artificial neuron (in LLM / BDH): This is, in fact, a highly simplified mathematical operation within a neural network. It takes values from the previous layer, multiplies them by weights, sums them up, and passes them through an activation function (e.g., ReLU). Compared to a biological neuron, this is an extremely simplified computational model. Biological neuron: This is a highly complex electrochemical information processing unit. It has extensive dendrites that can integrate signals locally. Some studies suggest that realistic digital models of a single neuron may require much more complex structures than a single element of a neural network. en.wikipedia.org/wiki/Neuron#/m…
English
1
0
7
375
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@linuz90 I feel the same. There was a different vibe back then. That said I have to admit the recent ones are very well produced and quite spectacular.
English
0
0
0
33
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@victoria_framer One at a time. I prefer focusing on a single thing rather than juggling multiple projects,too many at once start to feel a bit overwhelming 😅
English
0
0
0
96
Victoria
Victoria@victoria_framer·
Do you prefer working on one project at a time, or juggling several?
English
35
0
37
3.4K
Antonio Lupetti
Antonio Lupetti@antoniolupetti·
@ComputerLove_ I still remember moving from DOS 6 to Windows 3.1.... it really felt like a big step at the time. That interface looked great back then… and it still has a certain appeal today!
English
1
0
4
102
Computer ♥ Records
Computer ♥ Records@ComputerLove_·
On this day in 1992, Microsoft released Windows 3.1.
Computer ♥ Records tweet media
English
10
58
349
7.7K