Ned Nufre Sella
21 posts


@ylecun @dorian_omi Yes right. And at the end the winner is: Barlow Twins … ;-)
English

@dorian_omi The jury is still out as to which SSL method is best among infomax methods (VCReg, MMCR, MCR2) and distillation methods (I-JEPA, DINO, BYOL).
English

An NYU-CDS blog post about a recent paper by a (very) large cast of characters from Stanford, MIT, NYU, and Meta-FAIR on Self-Supervised Learning (SSL) through information maximization.
Unless one uses a preventive mechanism, training joint embedding architectures with SSL leads to a collapse: the representation learned by the system is uninformative, or even constant.
A number of methods have been devised to prevent this collapse.
One class of methods is sample-contrastive: ensure that different inputs produce different representations.
Another class is dimension-contrastive: ensure that different variables of the representation encode different aspects of the input.
Both types of methods can be derived from information maximization arguments: make sure the representation encodes as much information as possible about the input.
Variance-Covariance Regularization, MMCR, and MCR2 (from Yi Ma's group at Berkeley) are all infomax dimension-contrastive methods. They push the encoder to learn representations of the input that fill up the representation space as much as possible.
Paper: arxiv.org/pdf/2406.09366
NYU Center for Data Science@NYUDataScience
CDS researchers @ziv_ravid and @ylecun, et al, advance an entirely new kind of self-supervised learning: Maximum Manifold Capacity Representations (MMCR). MMCR breaks away from traditional SSL methods, though still connects with them via info theory. nyudatascience.medium.com/maximum-manifo…
English

@lexfridman 0MG Lex - you want to be neutral in face of a fascist takeover. In my opinion, a poor judgement from someone I always appreciated
English

I think that neither Trump nor Harris will destroy America if elected president.
Call me crazy, but I think that Trump is not a fascist and Harris is not a communist.
I think this is a reasonable rational position, but according to the internet it's insane 🤣
Either way, getting attacked by both sides has been mentally exhausting for me. Perhaps that's the design of the current political climate: anyone with moderate open-mindedness needs to be pushed out in favor of a "battle" between dogmatic extremes. This doesn't seem like the right path toward truth.
English

@SawyerMerritt The stock decline is all a ploy by the left to attack Elon for his support of Trump. Pathetic attempt.
English

RBC Capital's Tom Narayan on Tesla: "Elon doesn't think about things on a day to day or month to month basis; He's looking at things from a years if not decades perspective. Eventually we'll get this catalyst with the next-gen vehicle; Nobody's talking about energy storage; If you guys have ever used FSD. It's the most amazing product I've used since the iPhone."
English

@simongerman600 I agree. Shameful, but not even close to what the Romans, Mongols, Aztecs, Arabs and many others did.
English

@JuedischeOnline Bitte Doktor konsultieren! Das ist purer Rassismus
Deutsch

Die Zivilisten in Gaza sind nicht unschuldig: Wenn es so etwas wie kollektive Verantwortung für Verbrechen gibt, dann trifft dies im Falle des 7. Oktober zu. Eine Klarstellung von unserem Gastautor Tobias Huch. juedische-allgemeine.de/meinung/zivili…
Deutsch

@abelian_cat @fchollet Wrong. In German we call the W „Wee“ and the V „Fau“
English

@fchollet Most Romance languages call it "double V" I think. Even among the Germanic ones, English might be the exception.
English

@francoisfleuret As a German resident in austria you have to book a reservation in the ambassy 3-4 months ahead, get treated by staff like a criminal, and have to wait another 6-8 weeks for delivery
English

@engineers_feed @NASA You mean the temperature of the land surface ?
English

@darioperkins Better your equity strategists first takes a basis class in probability
English

@fchollet Biological systems are optimized wrt energy consumption
English

@ICannot_Enough Any graph on the rel share of tsla wrt all EV (eg. Competitors)?
English
Ned Nufre Sella retweetledi















