
Introducing MยฒRNN: Non-Linear RNNs with Matrix-Valued States for Scalable Language Modeling We bring back non-linear recurrence to language modeling and show it's been held back by small state sizes, not by non-linearity itself. ๐ Paper: arxiv.org/abs/2603.14360 ๐ป Code: github.com/open-lm-engineโฆ ๐ค Models: huggingface.co/collections/opโฆ




















