Sabitlenmiş Tweet

Slides from my talk at @push_conf about Conversational Experiences for Humans. #bots #chatbots slideshare.net/mrkrumhausen/c…
English
Sebastian Krumhausen
424 posts

@krumhausen
Product manager and digital strategist @telusdigital, @surebot. I'm currently building chatbots and design systems 🤖


Introducing SubQ - a major breakthrough in LLM intelligence. It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA), And the first frontier model with a 12 million token context window which is: - 52x faster than FlashAttention at 1MM tokens - Less than 5% the cost of Opus Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention). Only a small fraction actually matter. @subquadratic finds and focuses only on the ones that do. That's nearly 1,000x less compute and a new way for LLMs to scale.












