Aleph Alpha

🚀 Sovereign AI for the world. Cohere & Aleph Alpha form transatlantic AI powerhouse anchored in Canada & Germany! Combining our global scale with European R&D excellence to build sovereign, enterprise-grade AI. Security, privacy & trust for businesses & governments worldwide. #SovereignAI #AIPartnership Learn more: businesswire.com/news/home/2026… Image from left to right: Rolf Schumann, Schwarz Digits, Samuel Weinbach, Aleph Alpha, Aidan Gomez, Cohere, Minister Solomon, Canada, Minister Wildberger, Germany

Today, we announce a landmark agreement with @cohere. By uniting our European research depth with global AI scale, we are building a transatlantic AI powerhouse to give enterprises control over their AI. Learn more about our shared vision here: businesswire.com/news/home/2026…

We're also releasing the full pretraining trajectory: 200 checkpoints across 4 trillion words, allowing researchers to study learning dynamics in byte-models for the first time.

The report details HATification at the 8B and 70B scale, and training of a 7B model from scratch. The full report covers our pre- and post-training pipeline with detailed evaluations: arxiv.org/abs/2603.15953

We are releasing a detailed tech report for the tokenizer-free model family first introduced at ICLR 2025. These models achieve a significantly higher compression rate than standard LLMs, especially beyond English. 🧵

Introducing Alpha-MoE: A fused megakernel for faster tensor parallel inference. With up to 200% speedups for MoE models in TP deployments. Optimized for Hopper. Built for sovereignty and scale. aleph-alpha.com/alpha-moe-a-me…

Inference isn’t just about speed. Our latest blog breaks down how hardware choices impact latency, throughput & cost when serving massive models like DeepSeek v3. Read the blog & full report: aleph-alpha.com/deepseek-infer…

Try them out, experiment with the architecture, and see how tokenizer-free models handle your language or domain. Find our blog post here: aleph-alpha.com/introducing-tf… Or read our model cards: huggingface.co/collections/Al…

We’re shipping both models with: Hugging Face inference for easy testing vLLM fork optimized for HAT – note this is still under active development Weights & inference code are available today under Open Aleph license for research and educational use.

Introducing two new tokenizer-free LLM checkpoints from our research lab: TFree-HAT 7B Built on our Hierarchical Autoregressive Transformer (HAT) architecture, these models achieve top-tier German and English performance while processing text on a UTF-8 byte level.

We signed it, sending a signal to the world. The EU’s AI Code of Practice isn’t just another piece of regulation. It’s a declaration. Of what AI can be when built with transparency, responsibility and sovereignty. Just like ours. aleph-alpha.com/a-signature-an…

Read our paper for more information: arxiv.org/abs/2505.00022

For #ICLR2025 we are unveiling a new, high-quality pretraining dataset for German LLMs. Shared to strengthen the open research community. Shaped by our belief in excellence and transparency. huggingface.co/datasets/Aleph…

We gathered here to m#ourn the tokenizer, whose time has passed. We released three 8B models – and said goodbye to an old friend. Find our models on Huggingface: huggingface.co/collections/Al… And read more in our paper: arxiv.org/abs/2501.10322 #RIPTokenizer