Theoretical Foundations of Foundation Models
38 posts
@tf2m_workshop
Workshop on Theoretical Foundations of Foundation Models @icmlconf 2024.
Join us for the Workshop on Theoretical Foundations of Foundation Models @icmlconf tomorrow! We have a fantastic list of invited speakers: - @th33rtha - @DAlistarh - @jasondeanlee - @kamalikac - @tydsh 1/3
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Join us for the Workshop on Theoretical Foundations of Foundation Models @icmlconf tomorrow! We have a fantastic list of invited speakers: - @th33rtha - @DAlistarh - @jasondeanlee - @kamalikac - @tydsh 1/3
Transformers need glasses! 👓 Read on to see how we expose fundamental weaknesses of decoder-only Transformers on important tasks (e.g. copying & counting) + simple ways to make things a bit easier on the Transformer :) Work led by @fedzbar for his @GoogleDeepMind placement!
The program includes invited talks from - Ananda Theertha Suresh @th33rtha (Google Research) - Dan Alistarh @DAlistarh (IST Austria) - Jason Lee @jasondeanlee (Princeton) - Kamalika Chaudhuri @kamalikac (UCSD & Meta) - Yuandong Tian @tydsh (Meta)
Excited to give an oral presentation at #ICML2024 on Tuesday from 4:30 PM (2E Attention, Straus 1-3) on the loss landscape and optimization dynamics of Transformers for in-context learning from a mean-field & feature learning perspective!
We are excited to announce that 58 excellent papers will be presented at the @icmlconf TF2M Workshop. List of accepted papers: #tab-accept-poster" target="_blank" rel="nofollow noopener">openreview.net/group?id=ICML.…
You can find the detailed schedule on our website (and below 👇): sites.google.com/view/tf2m
