Rohan Taori

A statement on the comments from Secretary of War Pete Hegseth. anthropic.com/news/statement…

I'll be discussing work on using AI for pharmacovigilance (led by @claudeai 😉 ) as a Spotlight in #Agents4Science today at 11:00am PST! It was really fun participating in @james_y_zou's experiment on what happens if we let an LM lead a research project agents4science.stanford.edu

It was a dream come true to teach the course I wish existed at the start of my PhD. We built up the algorithmic foundations of modern-day RL, imitation learning, and RLHF, going deeper than the usual "grab bag of tricks". All 25 lectures + 150 pages of notes are now public! 🧵

@inerati triangle AIO twins :) connects to TV but can also play over bluetooth or wifi. phenomenal sound quality

my tv speakers make weird crackling sounds sometimes. what non annoying to deal with speaker thing should i get? there’s no clear place to mount a bar thing and it’s awkwardly in the corner

Game 4 DUB

I think CS336 has one of the best LLM problem sets of any AI/LM class thanks to our incredible TAs (@nelsonfliu,@GabrielPoesia,@marcelroed,@neilbband,@rckpudi). We're making it so you can do it all at home, and it's one of the best ways to learn LLMs deeply.

Introducing Claude 3.7 Sonnet: our most intelligent model to date. It's a hybrid reasoning model, producing near-instant responses or extended, step-by-step thinking. One model, two ways to think. We’re also releasing an agentic coding tool: Claude Code.

Claude 3.5 Haiku is now available on our API, Amazon Bedrock, and Google Cloud's Vertex AI. Haiku is fast and particularly strong at coding. It outperforms state-of-the-art models—including GPT-4o—on SWE-bench Verified, which measures how models solve real software issues.

imessage needs a spam filter

dreaming of traipsing through the forest and yapping

@inerati @secplsnobully LOLOL but if u don't keep tweeting you'll run out of lore eventually.... or am i just underestimating how deep this goes 🤨

@secplsnobully twitter now exists as a historical artifact i pull liz lore from to entertain @rtaori13

sorry tweeting is just less interesting and entertaining than real life now. i will keep barely tweeting for the foreseeable future (until i take a coerced vacation and get bored)

Sahara AI raised $43M to build a collaborative AI economy! Co-led by @PanteraCapital, @BinanceLabs, and @polychain, this funding brings us closer to a future of open, equitable, and secure AI through our decentralized AI blockchain platform. We also saw participation from @SamsungNext, @Sequoia, @matrixvc, @daofive, @geek_cartel, @NomadCapital_io, @SCB10X_OFFICIAL, @CanonicalCrypto, @mirana, @ForesightVen, @aegis_ventures, @DispersionVC, @tangent_xyz, @alumniventures, among others. Moreover, we're proud to have the support from the brightest minds in AI like: - Laksh Vaaman Sehgal from @MothersonGroup - Rohan Taori (@rtaori13) from @AnthropicAI & @StanfordAILab - Teknium (@teknium) from @NousResearch - Vipul Prakash (@vipulved) from @togethercompute - Elvis Zhang (@elvzhangg) from @midjourney, and more Whether you're an AI enthusiast, a data scientist, a business leader, or simply passionate about the potential of technology to change the world, there's a place for you in the collaborative AI economy! Read more on how you can join our mission: saharalabs.ai/blog/sahara-ai…

Join us at the co-located <AI / ALL> summit on Aug 15, with the social party in the evening! lu.ma/mxcx5bia co-hosted with @SCB10X_OFFICIAL @SambaNovaAI sponsored by @awscloud participated by folks @AIatMeta @google @CohereForAI @togethercompute

@lawhsw omg i want one

don’t worry about it babe it’s just a brand

@ZeyuanAllenZhu Sorry to hear :( Was really looking forward to watching the talk today! The nuggets of information are gold. @icmlconf can we revisit the strikedown of the video please? It's a bit outrageous

Bad news (1/2): video taken down by ICML (brockmeyer@icml.cc) for copyright. While I can't agree (the consent I signed allows me to publish elsewhere) - I will respect it to save time for more important things. To bad I delayed many things and spent 20+ hrs preparing the video.

airpods pro gen2 are truly underrated. so much happiness in such a tiny package

@inerati ❤️

i’m so tired of it all

I’m excited to share a project I’ve been working on for over a year, which I believe will fundamentally change our approach to language models. We’ve designed a new architecture, which replaces the hidden state of an RNN with a machine learning model. This model compresses context through actual gradient descent on input tokens. We call our method “Test-Time-Training layers.” TTT layers directly replace attention, and unlock linear complexity architectures with expressive memory, allowing us to train LLMs with millions (someday billions) of tokens in context. Our instantiations, TTT-Linear and TTT-MLP, both match or beat the strongest Transformers and Mamba. Arxiv: arxiv.org/abs/2407.04620

Claude with Artifacts x @dingboard_ collab

Introducing Claude 3.5 Sonnet—our most intelligent model yet. This is the first release in our 3.5 model family. Sonnet now outperforms competitor models on key evaluations, at twice the speed of Claude 3 Opus and one-fifth the cost. Try it for free: claude.ai