Sebastian

Learning to remove noise from images yields fantastic image generators. Here's how you can use diffusion models to solve Combinatorial Optimization problems by removing noise from solutions that you don't even have! To be presented @ICML 2024, 🧵👇

Presenting our spotlight paper on trust regions for optimal control at NeurIPS, arxiv.org/pdf/2508.12511. We show that KL-equipspaced measure transport can be interpreted as geometric annealing with adaptive step sizes, leading to major performance gains on hard control problems.

Links: neurips.cc/virtual/2025/l… arxiv.org/abs/2506.10982

If you’re at NeurIPS in San Diego next week, we’d love to connect and discuss our work. Joint work with: @lugruber0, Christoph Bartmann, @HochreiterSepp, @sebaLeh

Ever experienced instabilities when using the popular LV (Log Variance) loss for training Diffusion Bridge Samplers?

🚀 Excited to share our new paper on scaling laws for xLSTMs vs. Transformers. Key result: xLSTM models Pareto-dominate Transformers in cross-entropy loss. - At fixed FLOP budgets → xLSTMs perform better - At fixed validation loss → xLSTMs need fewer FLOPs 🧵 Details in thread

🔥 New workshop at @NeurIPSConf! DiffCoALG bridges the gap between classic algorithms & differentiable learning. Think: LLM reasoning, routing, SAT, MIP — neurally optimized end-to-end. 📌 Submit by Aug 22! 🔗 sites.google.com/view/diffcoalg… #NeurIPS2025

General relativity 🤝 neural fields This simulation of a black hole is coming from our neural networks 🚀 We introduce Einstein Fields, a compact NN representation for 4D numerical relativity. EinFields are designed to handle the tensorial properties of GR and its derivatives.

Ever wondered how linear RNNs like #mLSTM (#xLSTM) or #Mamba can be extended to multiple dimensions? Check out "pLSTM: parallelizable Linear Source Transition Mark networks". #pLSTM works on sequences, images, (directed acyclic) graphs. Paper link: arxiv.org/abs/2506.11997

We’re excited to introduce TiRex — a pre-trained time series forecasting model based on an xLSTM architecture.

Recommended read for the weekend: Sepp Hochreiter's book on AI! Lots of fun anecdotes and easily accessible basics on AI! beneventopublishing.com/ecowing/produk…

Happy to introduce 🔥LaM-SLidE🔥! We show how trajectories of spatial dynamical systems can be modeled in latent space by --> leveraging IDENTIFIERS. 📚Paper: arxiv.org/abs/2502.12128 💻Code: github.com/ml-jku/LaM-SLi… 📝Blog: ml-jku.github.io/LaM-SLidE/ 1/n

11/11 This is joint work with @willberghammer, @haoyu_wang66, @EnnemoserMartin, @HochreiterSepp, and @sebaleh. See you at #ICLR! [Poster Link](iclr.cc/virtual/2025/p…) [Paper Link](arxiv.org/abs/2502.08696) ---

10/11 🏆 Our method outperforms autoregressive approaches on Ising model benchmarks and opens new avenues for applying diffusion models to a wide range of scientific applications in discrete domains.

1/11 Excited to present our latest work "Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics" at #ICLR2025 on Fri 25 Apr at 10 am! #CombinatorialOptimization #StatisticalPhysics #DiffusionModels