Ran Shaul

Specialised players like @khealth are better positioned. They are working with large Healthcare Systems and running their AI suite of Agents in actual clinal settings…in April they published a relevant study with @CedarsSinai relayed by @Forbes in this article: forbes.com/sites/amyfeldm…

Mass General Brigham and @khealth can fix primary care using AI and new approaches to scaling high quality care delivery in MA and beyond beckershospitalreview.com/healthcare-inf…

We're big fans of @CMSGov work is doing around freeing up data and leveraging AI to empower patients and doctors. Led by @DrOz and the A team of Amy Gleason, Arda Kara and Alberto Colon Yesterday we pledged to support this initiative cms.gov/health-tech-ec…

Exciting to see our growing partnership with @MayoPlatform with many health systems that will be adopting @khealth AI Physician Mode capabilities hitconsultant.net/2025/05/13/k-h…

🚨New @AnnalsofIM paper: In 461 @CedarsSinaivirtual urgent care cases with common symptoms, @khealth AI recommendations were rated optimal more often than physicians' (77% vs 67%), & less often potentially harmful (2.8% vs 4.6%). doi.org/10.7326/annals…

When physicians with access to A.I. were compared with A.I. for virtual urgent care visits The A.I. performed better. @AnnalsofIM acpjournals.org/doi/10.7326/AN…

We are announcing today the results of a major study of K Health’s AI Physician Mode study with Cedars Sinai. Published in the Annals of Internal Medicine. The bottom line is K’s AI has performed better than doctors in a whole host of acute complaints in real life primary care settings. This is based on 8 years of building our platform: real high quality data real AI co-pilot in medical care delivery real patient settings This is not a medical textbook comparison. These are real life patients. Study: acpjournals.org/doi/10.7326/AN…

Bethany I hope you're doing well!  After reading your scary medical story I want to point out that while you think Chatgpt saved your life, in fact it gave you bad medical advice on the outset and missed a dangerous escalation in your health. Simply put, a petechial rash is a red flag warning sign that should be immediately addressed in an ER setting, but instead it accepted the suggestion that the cause was dietary. That is a huge miss and could have dangerously delayed your care. ChatGPT is an amazing translator of medical terms but is not a full blown system of care. more in the thread below

1) DeepSeek r1 is real with important nuances. Most important is the fact that r1 is so much cheaper and more efficient to inference than o1, not from the $6m training figure. r1 costs 93% less to *use* than o1 per each API, can be run locally on a high end work station and does not seem to have hit any rate limits which is wild. Simple math is that every 1b active parameters requires 1 gb of RAM in FP8, so r1 requires 37 gb of RAM. Batching massively lowers costs and more compute increases tokens/second so still advantages to inference in the cloud. Would also note that there are true geopolitical dynamics at play here and I don’t think it is a coincidence that this came out right after “Stargate.” RIP, $500 billion - we hardly even knew you. Real: 1) It is/was the #1 download in the relevant App Store category. Obviously ahead of ChatGPT; something neither Gemini nor Claude was able to accomplish. 2) It is comparable to o1 from a quality perspective although lags o3. 3) There were real algorithmic breakthroughs that led to it being dramatically more efficient both to train and inference. Training in FP8, MLA and multi-token prediction are significant. 4) It is easy to verify that the r1 training run only cost $6m. While this is literally true, it is also *deeply* misleading. 5) Even their hardware architecture is novel and I will note that they use PCI-Express for scale up. Nuance: 1) The $6m does not include “costs associated with prior research and ablation experiments on architectures, algorithms and data” per the technical paper. “Other than that Mrs. Lincoln, how was the play?” This means that it is possible to train an r1 quality model with a $6m run *if* a lab has already spent hundreds of millions of dollars on prior research and has access to much larger clusters. Deepseek obviously has way more than 2048 H800s; one of their earlier papers referenced a cluster of 10k A100s. An equivalently smart team can’t just spin up a 2000 GPU cluster and train r1 from scratch with $6m. Roughly 20% of Nvidia’s revenue goes through Singapore. 20% of Nvidia’s GPUs are probably not in Singapore despite their best efforts. 2) There was a lot of distillation - i.e. it is unlikely they could have trained this without unhindered access to GPT-4o and o1. As @altcap pointed out to me yesterday, kinda funny to restrict access to leading edge GPUs and not do anything about China’s ability to distill leading edge American models - obviously defeats the purpose of the export restrictions. Why buy the cow when you can get the milk for free?

Open-source models empower application layer developers to construct precise and highly customized models tailored to specific use cases. This ensures that the competitive edge lies not in foundational models themselves, but in creating value directly for the end-user

@GavinSBaker Thank you for making sense!

Stargate is a great name but the $500b is a ridiculous number and no one should take it seriously unless SoftBank is going to sell all of their BABA and ARM. SoftBank has $38b in cash, $142b in debt and generates $3ish billion in FCF per BBG. They own $143b in ARM and $18b in BABA. If they start selling ARM, their stake will be worth much less very quickly. Oracle has $11b in cash, $88b in debt and generates $10b in FCF. OpenAI is burning cash. MGX did not commit to a number and is a $100b fund. Maybe 10% of the fund goes into this best case. Nvidia will limit how much they invest in any one model company (they don’t need a monopsony). Maybe $5b. Barring the aforementioned SoftBank ARM sale, might be able to put together $50b in equity funding over several years. Can obviously finance the GPUs and put debt on the JV. Nowhere close to $500b. Everyone should just start issuing press releases for $1 trillion AI projects. BTW love it that the ticker MGX which is a biotech company is up 33% on this. If you a professional investor or analyst and you took $500b at face value - or even worse wrote a *note* about this - you should resign in disgrace.

Interesting perspective. I do see a slowdown in the modeling capabilities. There's a lot happening on the application layer, but not so much in the modeling capabilities themselves theatlantic.com/technology/arc…

It feels right. It's hard to imagine a future where a physician wouldn't team up with an AI physician, much like a pilot uses autopilot. Both are highly skilled professions.

This seems about right from @Benioff "LLMs upper limit reached…future is AI agents" In the healthcare industry this is 💯 true as seen by @khealth - the AI physician is coming to a practice near you…. cointelegraph.com/news/salesforc…

@marceloclaure and @GraciasAntonio speaking about @khealth @FIIKSA They share our journey to transform primary care through clinical AI, solving the need to provide high quality access to medicine for all humanity

Super excited to announce @khealth major new partnership is with @HMHNewJersey (Hackensack Meridian Health). Together with @BobCGarrett Dr Dan Varga, Jim Blazar and their teams we will significantly increase access to high quality medicine in NJ. @ShaulRan shorturl.at/tYIcX

We've built the first LLM Agent that's grounded in the patient's EMR that can provide personalized answers for clinical and health related questions. shorturl.at/ayIKS

United Optum telehealth and Walmart Health closing mean that we're finally moving to primary care that works - in @khealth case it's 24X7 clinical AI that is embedded into major health systems and allows personalized care and true LPR shorturl.at/gluV8 shorturl.at/dnKP0

Would you let your kids go to @Columbia ? I feel for the parents who worked their entire life, who took loans, mortgaged their house, “pursuing the American dream” of — one day sending their kids to a great school, to get great education. And then one day wake up and go “honey, isn’t that …”. Seeing their kids on the @Nytimes on the wrong side… (of history). Talk about Ivy League going Oopsi … nytimes.com/2024/04/21/nyr…

Scott ... Israel loves you. You use numbers, and data to let the story tell itself. Here is the thing. This war will end, we will win, we will get stronger, and in fact we will all move on, like people tend to do. But one thing will stay ... the pictures, the names, the identity of the wolves around us. They were always there, but we now see them, we know who they are, we see their faces on NYTimes articles, we see them in universities, we see them denying professors from accessing campus, they are protesting, they are out there hating, they are not nice people. We will win. We will become stronger. But the wolves ... they are here to stay, and at last, we know who they are. Keep up the good work Scott, we're behind ya. cc @profgalloway @ShaiDavidai @MSNBC