Alex Shtoff

10.8K posts

Alex Shtoff banner
Alex Shtoff

Alex Shtoff

@AlexShtf

Ph.D. Principal Scientist @ TII. Ex @YahooResearch. I do machine learning ∩ numerical methods ∩ SW development.

Israel Katılım Ağustos 2012
287 Takip Edilen1.2K Takipçiler
Sabitlenmiş Tweet
Alex Shtoff
Alex Shtoff@AlexShtf·
New post in my "Eigenvalues as models" series. This one asks a practical question: can eigenvalue-based models be made much cheaper to train and evaluate without collapsing into something too simple to be interesting? Dense matrices are expressive but expensive. Fully diagonal ones are cheap but too restrictive. In this post I explore a middle ground that turned out to be much more useful than I expected. It is probably the most implementation-focused entry in the series so far: structured matrices, PyTorch/SciPy plumbing, and experiments. If you care about spectral methods, differentiable numerical linear algebra, or unusual tabular model classes, this is post and the entire series is for you: alexshtf.github.io/2026/03/15/Spe…
English
1
11
49
3K
Alex Shtoff
Alex Shtoff@AlexShtf·
@araghchi Then what is Hezbullah, if not Iran sneak-attacking adversaries? Orders come from Tehran, not Beirut.
English
0
0
1
75
Seyed Abbas Araghchi
We are men and women of principles. Iranians do not sneak attack adversaries while engaged in dialogue. Only when attacked do we powerfully respond. We have intelligence on Israeli plans to strike infrastructure. Once again: ZERO restraint if our infrastructure is attacked.
English
1.3K
9.5K
34.9K
943.5K
Santiago
Santiago@svpino·
75% of the replies I get are now AI slop. I can't block them because I've been told that blocking too many accounts will reduce my reach. I don't block them → they keep spamming me. I block them → fewer humans see my writing. What are we supposed to do?
English
167
6
166
9.8K
Amit Segal
Amit Segal@AmitSegal·
Iranian missile near Temple Mount — and they are shouting that Al-Aqsa is in danger.
Amit Segal tweet media
English
74
166
929
66.4K
Alex Shtoff
Alex Shtoff@AlexShtf·
@PastorMarvy Hormuz is half Oman's. So why would ships go through Iran's half for a fee, if they can go through Oman's half for free?
English
2
0
2
8.1K
Alex Shtoff
Alex Shtoff@AlexShtf·
@MaxBlumenthal Obviously, it's the bridge, and not your buddy Steve that was the target. The military did not target him, it ignored him. And rightfully so. The military said it will destroy the bridges and asked everybody to move away. He did not - his problem.
English
1
0
1
203
Max Blumenthal
Max Blumenthal@MaxBlumenthal·
Israel just attempted to assassinate the great Steve Sweeney while he was reporting from Southern Lebanon Relieved to hear Steve is recovering The terrorist regime that has murdered hundreds of journalists over 2-3 years will never recover from this
English
1.2K
19.2K
62.5K
1.2M
Alex Shtoff
Alex Shtoff@AlexShtf·
The point is that the bridge he was standing on was a target. The israelis announced it beforehand and told everybody to get away. He wasn't standing just in a war zone - he was standing on the target that was supposed to be bombed. And it was bombed. Ignoring him. Not targeting him - ignoring him.
English
0
0
0
6
Alex Shtoff
Alex Shtoff@AlexShtf·
@Lowkey0nline Have you thought the idea that the target was.... the bridge, that's not yet been fully destroyed by the previous strike? You know - like they said they'll do - destroy those bridges?
English
0
0
0
90
Lowkey
Lowkey@Lowkey0nline·
The moment Israel targeted British journalist Steve Sweeney in southern Lebanon.
English
2.4K
41.3K
153.8K
14.8M
Alex Shtoff
Alex Shtoff@AlexShtf·
Font rendering is a solved problems. Then why can't MacOS properly render fonts on anything that is not their retina display?
English
0
0
0
38
Alex Shtoff
Alex Shtoff@AlexShtf·
@inerati Because nobody cares, and people still use it and even pay for it.
English
0
0
1
119
liz
liz@inerati·
why is all software so horrifically bad
English
45
18
407
19.1K
Alex Shtoff
Alex Shtoff@AlexShtf·
@tridento @ArcherNightfall @CraigMurrayOrg LOL the "local regime" does not such thing. Moreover, I can call the "local regime" a corrupt pig, and nothing will happen to me. Here, I said it - Bibi isca corrupt pig. I enjoy freedom of speech.
English
0
0
0
118
Craig Murray
Craig Murray@CraigMurrayOrg·
Iran has hit Israel particularly hard today. Yet there is zero footage or photos in my timeline, literally zero.
English
535
3.6K
32.1K
848.1K
Alex Shtoff
Alex Shtoff@AlexShtf·
Well, here it's obviously a fixed point, but not in a sense similar to a regular neural network. An eigenvalue is a solution of a min-max optimization problem, which satisfies the stationarity conditions. So the eigenvector is a fixed point, but the eigenvalue is apparently not.
English
1
0
0
33
Calc Consulting
Calc Consulting@CalcCon·
The RG analysis can be applied to any non-linear function approaching a fixed point The idea is the non-linear function can be linearized near its fixed point. So near the optimum it becomes a linear operator and the eigenvalue distribution stabilizes (ie becomes marginal) in the infinite limit of training At that point, it’s just a question what are the symmetries of the system? what I have found in our work is that the symmetry is a scale invariant volume preserving transformation That is the underlying linear operator becomes low rank and its determinant is unity.
English
1
0
1
46
Alex Shtoff
Alex Shtoff@AlexShtf·
New post in my "Eigenvalues as models" series. This one asks a practical question: can eigenvalue-based models be made much cheaper to train and evaluate without collapsing into something too simple to be interesting? Dense matrices are expressive but expensive. Fully diagonal ones are cheap but too restrictive. In this post I explore a middle ground that turned out to be much more useful than I expected. It is probably the most implementation-focused entry in the series so far: structured matrices, PyTorch/SciPy plumbing, and experiments. If you care about spectral methods, differentiable numerical linear algebra, or unusual tabular model classes, this is post and the entire series is for you: alexshtf.github.io/2026/03/15/Spe…
English
1
11
49
3K
Alex Shtoff
Alex Shtoff@AlexShtf·
@tomer2010 @MPTG84 מה שבטוח - אף אחד לא הבטיח 100 אחוז ירוט. גם אם רק 10 אחוז פוגעים, זה די הרבה נזק. ונראה שזה מעל 10 אחוז.
עברית
0
0
0
30
Tomer Korenfeld
Tomer Korenfeld@tomer2010·
@MPTG84 גם טילים רגילים יש לנו בעיה… לא הבטיחו ליו יירוטים מחוץ לאטמוספירה?
עברית
3
0
0
334
Maayan Paz
Maayan Paz@MPTG84·
האם יש לישראל בעיה ביירוט טילים בעלי רש״ק מצרר?
עברית
5
0
4
2.3K
Alex Shtoff
Alex Shtoff@AlexShtf·
That's interesting. So here instead of layer weights I have matrices in the linear pencil. These are also model parameters that are matrices. But I think in my case whats important is the eigenvalue gap. I want eigenvalue gaps to be as large as possible. This is not easy to achieve through theory.
English
2
0
1
48
Calc Consulting
Calc Consulting@CalcCon·
We have observed that the eigenvalue spectrum of layer weight matrices tend to be heavy, tailed power law, and follow the trace log condition on the eigenvalues in the power law tail The student teacher construct is theoretical machinery You don’t actually need to have a teacher and a student that works or just any model of your training. The alternative way of looking at this is that you expect during training the system to approach a fixed point therefore it is amenable to analysis using re-normalization group (RG) under RG the trace log condition is the underlying dynamical symmetry or Ward identity. using this identity It’s fairly easy to prove the distribution is heavy tailed and satisfies the symmetry that it will converse at the fixed point to a power law with PL exponent alpha=2
English
1
0
1
48
Alex Shtoff
Alex Shtoff@AlexShtf·
@CalcCon WDYM? I don't have teacher and student. So correlation between what and what? Please explain.
English
1
0
0
108
🚉🚲🏙🌳 naama riba
אנחנו אמורים להמשיך לחיות ככה? לתפקד? לעבוד? לנהל חיי משפחה?
עברית
474
37
931
144.4K
Alex Shtoff
Alex Shtoff@AlexShtf·
@alon_mizrahi Lol youre speaking as if it changes something. You cannot "decapitate" a democratic country. Policy is not one man's show, and it will change nothing.
English
0
0
0
124
Alon Mizrahi
Alon Mizrahi@alon_mizrahi·
Ok, something happened to Netanyahu 100%
English
817
2.7K
28K
2.6M