Khaled Saab

229 posts

Khaled Saab banner
Khaled Saab

Khaled Saab

@_khaledsaab

research @OpenAI, prev: @GoogleDeepMind @StanfordAILab @HazyResearch

California, USA Katılım Mart 2019
435 Takip Edilen2.9K Takipçiler
Khaled Saab retweetledi
Karan Singhal
Karan Singhal@thekaransinghal·
♥️ GPT-5.6 is a major step forward for health, both at the frontier and at cost. These models push the frontier of performance per dollar, bringing the best health intelligence to all. The smallest variant, GPT-5.6 Luna, evaluated at the lowest reasoning effort, outperforms GPT-5.5 at the highest reasoning effort–despite costing 25x less. The largest variant, GPT-5.6 Sol, sets a new high bar at cost. Another especially cool result: physicians found fewer flaws in GPT-5.6 responses than physician-written responses. We collected diverse tasks that remain difficult for recent OpenAI models, across patient-facing and clinician-facing use cases. We asked speciality-matched physicians to write responses to these tasks with unlimited time and web access. We then asked other physicians to compare responses side-by-side, blinded to their source. Physicians were asked to comment on areas of improvement across five axes: accuracy, communication, completeness, instruction following, and health decision helpfulness. We then reported the fraction of responses across sources rated perfectly across all axes, across 20,000 total axis ratings. GPT-5.6 Sol appeared strongest, although all GPT-5.6 models performed significantly better than physicians.
Karan Singhal tweet media
OpenAI@OpenAI

GPT-5.6 is a major step forward for health intelligence. Across the lineup, we’re delivering stronger performance at lower cost: GPT-5.6 Luna outperforms GPT-5.5 at its highest reasoning setting while costing 25x less. Together, these advances raise quality while making advanced models accessible to more people globally.

English
52
129
953
1.3M
Ashley Alexander
Ashley Alexander@AshleyYuki·
So proud to work with @thekaransinghal and his amazing research team that continues to democratize access to frontier health intelligence. New 5.6 models deliver better performance on health benchmarks at lower cost so everyone can benefit!
OpenAI@OpenAI

GPT-5.6 is a major step forward for health intelligence. Across the lineup, we’re delivering stronger performance at lower cost: GPT-5.6 Luna outperforms GPT-5.5 at its highest reasoning setting while costing 25x less. Together, these advances raise quality while making advanced models accessible to more people globally.

English
1
0
8
1.7K
Khaled Saab
Khaled Saab@_khaledsaab·
Our work on GPT-5.6 pushes the Pareto frontier of health intelligence! The health domain is uniquely challenging. There’s a long-tail of clinical scenarios (e.g., rare conditions and many medical modalities), often with incomplete information. We have strong conviction that scaling compute for health will continue to move the frontier forward.
OpenAI@OpenAI

GPT-5.6 is a major step forward for health intelligence. Across the lineup, we’re delivering stronger performance at lower cost: GPT-5.6 Luna outperforms GPT-5.5 at its highest reasoning setting while costing 25x less. Together, these advances raise quality while making advanced models accessible to more people globally.

English
1
2
18
2.2K
Khaled Saab retweetledi
Karan Singhal
Karan Singhal@thekaransinghal·
One of the ways scaling test-time compute can benefit people most: have reasoning models think really hard about rare undiagnosed diseases. Today we’re sharing published evidence that this can work, in some of the most difficult pediatric cases!
OpenAI@OpenAI

Together with researchers at Boston Children’s Hospital and Harvard, we published a study in NEJM AI showing how o3 Deep Research helped clinicians revisit previously unsolved rare pediatric disease cases, and find answers for families who had waited years.

English
110
91
842
441.9K
Albert Gu
Albert Gu@_albertgu·
Extremely proud of the team @cartesia for launching Sonic 3.5, which sets a new state of the art for TTS I personally led the technical direction of this model; we built it ground up from first principles, and it contains multiple non-trivial ideas that differ substantially from anything we’ve seen in the literature. It’s been very gratifying to see research bets play out and the strong research team at Cartesia continue to grow!
Artificial Analysis@ArtificialAnlys

Cartesia’s Sonic-3.5 takes the #1 spot on the Artificial Analysis Speech Arena Leaderboard, surpassing Inworld Realtime TTS 1.5 Max and Google’s Gemini 3.1 Flash TTS Sonic-3.5 is the latest TTS model from @cartesia . It supports 42 languages, including 9 Indian languages, with 500+ voices available out of the box. The model has been highly preferred among voters in the TTS Arena, with its demonstrated naturalness and accurate transcript following. Key takeaways: ➤ Quality: Sonic-3.5 has an Elo score of 1,218 (+16/-16) based on 1,144 arena appearances, placing it ahead of Inworld Realtime TTS 1.5 Max at 1,194 and Gemini 3.1 Flash TTS at 1,209 ➤ Pricing: Sonic-3.5 is priced at $39/1M characters, a premium compared to Gemini 3.1 Flash TTS at $18.3/1M characters, and Inworld Realtime TTS 1.5 Max at $35/1M characters ➤ Speed: 105.5 characters per second, compared to 205 characters per second for Inworld Realtime TTS 1.5 Max and 26.3 characters per second for Gemini 3.1 Flash TTS See more details and listen to samples below 🧵

English
6
19
189
20.9K
Vivek Natarajan
Vivek Natarajan@vivnat·
Out of all the announcements at @Google I/O today, this is the one closest to my heart - our foundational research on Co-Scientist was published in @Nature and we announced its broad availability via @GeminiApp for Science. When you are suffering from a disease, time is everything. As our collaborator and @StanfordMed Professor Dr. Gary Peltz reminds us, there are thousands of diseases out there with zero treatments. There is simply so much left to solve. Our goal with Co-Scientist has been to give scientists superpowers and help them get to these answers faster - compressing the scientific process from months and years down to hours and days. Much like Galileo's telescope helped us look into the stars, Co-Scientist is designed to help us make sense of the vast complexity of biological and scientific data. It is among the first examples of a truly general-purpose multi-agent system for scientific discovery. The core research question behind it was: How can an AI system engage in the rigorous, structured thinking that’s the hallmark of science and scientists? To tackle this, Co-Scientist builds on the principles of self-play and self-improvement underpinning @GoogleDeepMind breakthroughs like AlphaGo, generalizing them to scientific reasoning through self-debates. Since our preprint last year, we have further improved its capabilities and have been validating it in collaborations with scientists across over 100 institutions globally, spanning both academia and industry. And we are thrilled to see the emergence of a new form of AI-human scientist collaboration that's already leading to important new insights, discoveries and peer reviewed publications - from understanding antimicrobial resistance (published in @CellCellPress) to decoding plant immunity, to identifying new treatments for liver fibrosis (Advanced Science), cancer, neurodegenerative diseases like ALS and the grand challenge of aging. I have always believed AI's greatest promise is accelerating scientific discovery and advancing human health. My genuine hope for the future is that AI tools like Co-Scientist help democratize science, giving anyone, anywhere the means to pursue their child-like curiosity and change the world. This work was done with stellar team mates spanning @GoogleDeepMind @GoogleResearch, @googlecloud and @GoogleLabs especially Juro Gottweis (@Mysiak ), who is the heart and soul of this effort. Special thanks also to all our wonderful collaborators: Gary Peltz, @CostaT_Lab, @jrpenades, @_e_d_v_ , @iambyronic, @OpsBug, @jgooten, @omarabudayyeh Ritu Raman, Ryan Flynn, Filippo Menolascina, Velia Siciliano, Clare Bryant, Matt Onsum, Katherine Labbé and more. Nature paper link - lnkd.in/e8qBEJFv Google DeepMind blog - lnkd.in/etYeahMy Gemini for Science - labs.google/science.
English
19
114
530
82K
Khaled Saab
Khaled Saab@_khaledsaab·
Multimodal AMIE now published @NatureMedicine! This is from past work @GoogleDeepMind where we studied patients uploading images during diagnostic dialogue. We found that a multimodal reasoning harness that tracks a patient’s state greatly improves history taking and clinical accuracy. We also surpassed doctors across many evaluation axes in diverse primary care settings. nature.com/articles/s4159…
English
5
17
71
1.4M
Khaled Saab retweetledi
Shiv Rao, MD
Shiv Rao, MD@ShivdevRao·
GPT-5.5 early access results have been impressive. 25% lift in clinical quality. 30% less verbose. We orchestrate hundreds of AI tasks, some powered by our proprietary data flywheels, others by frontier models like GPT-5.5. We test rigorously for clinical accuracy, completeness, reasoning, real-world because benchmarking is a big deal in healthcare. Grateful to the OpenAI team for the early access and partnership.
Shiv Rao, MD tweet media
English
5
11
61
4.5K
Khaled Saab
Khaled Saab@_khaledsaab·
Doctors are increasingly using ChatGPT to supercharge their workflows in delivering care. To support this high impact domain, we take steps to make ChatGPT more accessible, accurate, and measurable for clinical work. openai.com/index/making-c…
Karan Singhal@thekaransinghal

Today we’re introducing two big steps for health at OpenAI: - ChatGPT for Clinicians, a free version of ChatGPT designed for clinical work - HealthBench Professional, a new benchmark to evaluate real clinician chat tasks We’re excited about what this can unlock for care. ❤️

English
0
1
19
1.7K
Khaled Saab retweetledi
Tibo
Tibo@thsottiaux·
Codex at 2M+ active users up 25% week over week... and that was before we launched the app on Windows and GPT-5.4!
English
90
40
1.5K
80.7K
Khaled Saab retweetledi
OpenAI
OpenAI@OpenAI·
Yesterday we reached an agreement with the Department of War for deploying advanced AI systems in classified environments, which we requested they make available to all AI companies. We think our deployment has more guardrails than any previous agreement for classified AI deployments, including Anthropic's. Here's why: openai.com/index/our-agre…
English
1.8K
566
3.8K
2.6M
Khaled Saab retweetledi
Boaz Barak
Boaz Barak@boazbaraktcs·
There is this narrative that up until this week, Anthropic had this wonderful contract that prevented the U.S. government from doing mass domestic surveillance or autonomous lethal weapons, and now all hell will break lose. As I wrote, I am not a fan of accelerating AI specifically in the national security space. If I had been an Anthropic employee at the time they signed their original deal with the DoW, I would have probably opposed it, especially given the reduced control since they worked through Palantir. And I don't think having some terms of use in the contract is what we can rely on to protect us. I believe the drama of the last week about these terms of use is more about politics than substance. The substance is about the details, which I hope more of which will come out soon. But it is wrong to present the OAI contract as if it is the same deal than Anthropic rejected, or even as if it is less protective of the red lines than the deal Anthropic already had in place before. Obviously I don't know all details of what Anthropic had before, but based on what I know, it is quite likely that the contract OAI signed gives *more* guarantees of no usage of models for mass domestic surveillance or autonomous lethal weapons than Anthropic ever had.
Boaz Barak@boazbaraktcs

Some thoughts (long tweet.. sorry). I would prefer if we focused first on using AI in science, healthcare, education and even just making money, than the military or law enforcement. I am no pacifist, but too many times national security has been used as an excuse to take people's freedoms (see patriot act). I am very worried about governments using AI to spy on their own people and consolidate power. I also think our current AI systems are nowhere nearly reliable enough to be used in autonomous lethal weapons. I would have preferred to take it slower with classified deployment, but if we are going to do it, it is crucial that we maintain the red lines of no domestic surveillance or autonomous lethal weapons. These are widely held positions, and codified in laws and regulations. They should be stipulated in any agreement, and (more importantly) verified via technical means. I think the terms of this agreement, as I understand them, are in line with these principles, that are also held by other AI companies too. I hope the DoW will offer them the same conditions. Regardless, a healthy AI industry is crucial for U.S. leadership. Whether or not relations have soured, there is zero justification to treat Anthropic - a leading American AI company whose founders are deeply patriotic and care very much about U.S. success - worse than the companies of our adversaries. It appears to me that much of this week's drama has been more about style and emotions than about substance. I hope that people can put this behind them, and come together for the benefit of our country.

English
47
25
238
121.8K
Khaled Saab retweetledi
Nathan Labenz
Nathan Labenz@labenz·
230M people use ChatGPT for health & wellness questions every week. 📈 A recent RCT showed that it improves patient outcomes. ⚕️ And soon... it will be FREE for ALL 👏 (with no ads!) - @thekaransinghal, @OpenAI Health Lead, on "Universal Medical Intelligence"
English
7
5
44
9.4K