What a week for everyone in tech, huh? Ahead of today's AI at Meta Llama 3.1 release, there's a bunch of mindblowing news about Small Language Model releases, as well as LLM breaking news such as Llama 3.1 405B allegedly leaking on HF/4chan.

For full coverage: check out genai360.beehiiv.com/p/of-llamas-an…

@AIatMeta's Llama v 3.1 405B outperforms GPT4-o and Claude Sonnet on more than 90% of benchmarks. - Has 128k context tokens - Was trained on 15 Trillions tokens 😱 (the number floating around for the OG GPT-4 was 13T) - Multilingual, but not yet multi-modal - and... shockingly:

- Possibly paywalled at a certain point as per this part of the code:

@OpenAI unveiled GPT-4o mini, a compact and cost-effective AI model for ChatGPT that outperforms leading small AI models on reasoning tasks while being 60% cheaper to operate than GPT-3.5 Turbo.