Meet Shah

Gemini Omni Flash is officially out! 🚀 It has been incredible working on the model pretraining, landing cool features in video editing, and pushing the 3D/camera capabilities in Omni. Seeing it live at #GoogleIO is surreal. 😍😇 Took countless days of no to little sleep. But sometimes it takes a little crazy to make something truly amazing. ✨✨✨ Go try it out! deepmind.google/models/gemini-… #googleemployee @GeminiApp @GoogleDeepMind #gemini #omni

(1/10) Excited to share our new paper: "Towards Conversational Medical AI with Eyes, Ears and a Voice" arxiv.org/abs/2605.09272 Clinical medicine depends on more than words; it relies on real-time visual cues (rashes, distress, gait), auditory signals (prosody, breathing), and guided physical exams (e.g., guiding someone through correcting their inhaler technique, or walking them through shoulder maneuvers to work up a rotator cuff injury). But existing conversational medical AI systems are blind and deaf to this crucial information and are constrained to rigid, turn-by-turn user experience. As an important ingredient in AI co-clinician, our new healthcare initiative at @GoogleDeepMind, we developed a first-of-its-kind real-time multimodal system that conducts natural clinical consultations over video calls while continuously watching, listening, and reasoning. The preprint details the research progress we’ve made so far together with our collaborators at @StanfordMed and @harvardmed (@AdamRodmanMD @euanashley @DrJackOSullivan @jasongusdorf). More details below!

@BIDMChealth @StanfordMed 9/ We are currently in a phased research approach with global collaborators ( 🇺🇸 🇦🇺 🇳🇿 🇦🇪 🇸🇬 🇮🇳) to ensure this is developed responsibly. Huge congratulations to everyone on the team and our partners for making this possible.

@BIDMChealth @StanfordMed 8/ We utilize a dual-agent architecture to decouple fluid multimodal interaction from deep clinical reasoning. A low-latency "Talker" handles empathetic dialogue, while a supervisory "Clinical Planner" monitors the encounter state.

1/ Introducing AI co-clinician: latest research milestone I’ve been a part of at @GoogleDeepmind, researching the evolution of care delivery where AI can support both patients & doctors. tech report: gstatic.com/vesper/ai_cocl… blogpost: deepmind.google/blog/ai-co-cli…

AI co-clinician is our new research initiative to help explore how multimodal agents could better support healthcare workers and patients. 🩺 Here’s a snapshot of our progress 🧵

I am happy to introduce AI co-clinician, @GoogleDeepMind's research initiative to explore how AI could better amplify doctor's expertise and help deliver higher quality care to patients. We’re excited about our early results, and are taking a phased approach to our research explorations with academic and research collaborators. Read more in our blog: deepmind.google/blog/ai-co-cli…

@debarghya_das This is very likely incorrect. 80K seems like total EB-1 approvals since 2012 [1]. 70K approved in one quarter means ~1076/day. That's unlikely as only 5-6 officers across 2 centers adjudicate the petitions. [1]: trackitt.com/usa-discussion…

USCIS just published their 2023 Q4 backlog data and for the first time ever.. India's added 70,000 approved EB-1 applicants to the backlog in a quarter! That's 2x EB-2 + EB-3 Indian applicants, which is unheard of. There are usually < 10,000 Indian EB-1 approvals a YEAR.

@deviparikh @apsdehal @vedanujg Oracle of Delphi has come a long way. Congratulations on the release!!

Anyone interested in vision and language (VQA, TextVQA, etc.) should check this out! For those of you familiar with it, this is Pythia with a major rewrite. Crazy amounts of amazing work by @apsdehal and @vedanujg! Try it and share feedback!

@karpathy I think bwamp.me solves exactly that.

One (of many) amusing socially awkward remote conference call interactions is when the speaker makes a joke. Everyone is mutated so it seems like it awkwardly falls flat, and noone wants to unmute just to say "haha". Calls still need many more features to bridge the real life gap

@kdexd If I had a dollar for everytime some conference paper used my framework without citing it 🙃.

@kdexd Ever typed bc in a terminal? ;)

TIL: In `if [ cond ]; then` of bash, `[` is a command and `]` is one of its args. Running `which [` gave me `/usr/bin/[` WTF?!

@abhshkdz You can always spin-up an EC-2 instance running overleaf as it's opensource :-) github.com/overleaf/overl…

Is it even a real deadline if Overleaf doesn't go down? #CVPR2020

VQA is consistently seeing tremendous progress year by year. Excited to see further progress as we now focus on specific sets of problems (reading text, consistency, external knowledge etc.). Planning research on V+L? Do have a look at Pythia github.com/facebookresear…