Sabitlenmiş Tweet
MedARC
131 posts
MedARC
@MedARC_AI
Medical AI Research Center (MedARC) Unlocking new possibilities in medical AI research. Supported by @SophontAI Founded by @iScienceLuvr
Katılım Ocak 2023
12 Takip Edilen6.7K Takipçiler
STARTING NOW!
MedARC@MedARC_AI
We're excited to announce we're starting a Journal Club. And our first meeting is scheduled for tomorrow! @__init_self will present her work, CorText: Brain-Language Fusion Enables Interactive Neural Readout and In-Silico Experimentation Tomorrow at 10:15am ET, join Discord!
English
We're excited to announce we're starting a Journal Club. And our first meeting is scheduled for tomorrow!
@__init_self will present her work, CorText: Brain-Language Fusion Enables Interactive Neural Readout and In-Silico Experimentation
Tomorrow at 10:15am ET, join Discord!
English
MedARC retweetledi
Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks
We (@SophontAI) recently released our medical benchmarking research on arXiv.
"We introduce Medmarks, a fully open-source evaluation suite with 30 benchmarks spanning question answering, information extraction, medical calculations, and open-ended clinical reasoning. We perform a systematic evaluation of 61 models across 71 configurations using verifiable metrics and LLM-as-a-Judge. Our results show that frontier reasoning models (Gemini 3 Pro Preview, GPT-5.1, & GPT-5.2) achieve the highest performance across both benchmarks, most frontier proprietary models are significantly more token efficient than open-weight alternatives, medically fine-tuned models outperform their generalist counterparts, and that models are susceptible to answer-order bias"
English
Medmarks was organized within MedARC, join the server to contribute to our continued eval efforts and medical post-training efforts!
Sophont@SophontAI
We're excited to release Medmarks v1.0 + a technical report! This is an update to our Medmarks benchmark suite, the largest open-source automated suite for evaluating the medical capabilities of LLMs. We added 10 benchmarks (20→30) and 15 models (46→61) to the leaderboard!
English
MedARC retweetledi
We're excited to release Medmarks v1.0 + a technical report!
This is an update to our Medmarks benchmark suite, the largest open-source automated suite for evaluating the medical capabilities of LLMs.
We added 10 benchmarks (20→30) and 15 models (46→61) to the leaderboard!
English
MedARC retweetledi
A good discussion about evaluating LLMs in medicine by the head of Health AI at OpenAI, highly recommend reading.
Appreciate the shoutout for Medmarks, our LLM evaluation suite developed at @SophontAI/@MedARC_AI. Glad to see even folks at frontier labs are finding it useful!
Karan Singhal@thekaransinghal
English
This release was only possible by the numerous MedARC volunteers who implemented benchmarks and datasets to evaluate with. Grateful to all those who contributed!
Sophont@SophontAI
We're releasing Medmarks v0.1, the largest completely open-source automated evaluation suite for assessing the medical capabilities of LLMs! Developed in our @MedARC_AI community, w/ support from @PrimeIntellect So far we’ve explored 46 models to figure out the best!
English
MedARC retweetledi
We're releasing Medmarks v0.1, the largest completely open-source automated evaluation suite for assessing the medical capabilities of LLMs!
Developed in our @MedARC_AI community, w/ support from @PrimeIntellect
So far we’ve explored 46 models to figure out the best!
English
MedARC retweetledi
Sophont had a great NeurIPS last week!
We presented our fMRI foundation model research at the Brain and Body Foundation Models workshop (which we also co-sponsored!)
We also held a social with @KindredVentures (and @_CausalLabs, @fal) including a great panel with our CEO Tanishq Abraham, MIT prof Paul Liang, Stanford prof James Zou, moderated by Kanyi Maqubela from Kindred. We discussed the importance of multimodal models for medicine, open-source, open research problems in the space, agents for accelerating scientific discovery, and so much more.
It was great to connect with so many folks interested in medical AI, see you next time!
English
The MedARC community was in full attendance at NeurIPS!
Sophont@SophontAI
Sophont had a great NeurIPS last week! We presented our fMRI foundation model research at the Brain and Body Foundation Models workshop (which we also co-sponsored!) We also held a social with @KindredVentures (and @_CausalLabs, @fal) including a great panel with our CEO Tanishq Abraham, MIT prof Paul Liang, Stanford prof James Zou, moderated by Kanyi Maqubela from Kindred. We discussed the importance of multimodal models for medicine, open-source, open research problems in the space, agents for accelerating scientific discovery, and so much more. It was great to connect with so many folks interested in medical AI, see you next time!
English
MedARC retweetledi
Check out OpenMidnight, our SOTA pathology foundation model.
Available on HuggingFace!
This model can be fine-tuned for a variety of usecases:
- classifying cancer type
- segmenting cells and tissue
- predicting genes activity from pathology image
and so much more!
Tanishq Mathew Abraham, Ph.D.@iScienceLuvr
Excited to share our latest @SophontAI release 🥳 "How to Train a State-of-the-Art Pathology Foundation Model with $1.6k" We present OpenMidnight, our first pathology foundation model! It has SOTA perf. despite being only trained on 12k whole slide images w/ $1.6k compute!
English
MedARC retweetledi
MedARC retweetledi
Excited to share our latest @SophontAI release 🥳
"How to Train a State-of-the-Art Pathology Foundation Model with $1.6k"
We present OpenMidnight, our first pathology foundation model!
It has SOTA perf. despite being only trained on 12k whole slide images w/ $1.6k compute!
English
MedARC retweetledi
Some personal news: I've joined @SophontAI to help build the next generation of open medical foundation models.
We've relaunched @MedARC_AI, our open science research community. Join us if you want to help advance open medical AI.
And we are hiring.
English
Sharing our work on training fMRI neuroimaging foundation models, to be presented at FMs for Brain & Body NeurIPS 2025 workshop
Although this was an internal Sophont research project, we are now expanding this at MedARC
If you're interested in contributing, join us in Discord!!
Sophont@SophontAI
Excited to share our first paper: Scaling Vision Transformers for Functional MRI with Flat Maps We introduce a new approach to training fMRI neuroimaging foundation models and demonstrate a strict dataset power scaling law!
English
MedARC retweetledi
Our team is working hard and doing great work, we have some cool research stuff to share this month, excited to release!
Be sure to follow @SophontAI and @MedARC_AI if you want to stay up to date!
English
MedARC retweetledi
yes we are! sophont.med/job_postings/l…
we also have open-source RL medical LLM research in @MedARC_AI discord
Drew@DeepGuessr
@iScienceLuvr Are you guys hiring RL people? Would be awesome to be able to have some compute to do RL experiments on med data
English
MedARC retweetledi
At @MedARC_AI we are building a comprehensive suite of medical LLM evals, and we already have tons of volunteers and lots of great progress!
The project started less than a week ago!
Are there other medical LLM evals we should include?
English
MedARC retweetledi
Excited to announce that @SophontAI has raised $9.22M in combined pre-seed+seed rounds! 🚀🔥
Led by @KindredVentures, with participation from @delphi_ventures @upfrontvc @AICONIC_VC
also @jeffdean, @logankilpatrick, @ClementDelangue (via Factorial Capital), @l2k & others
English
MedARC retweetledi
IMO a challenge limiting modern medical AI is that data + domain expertise are in hospitals & academia but they have no compute + AI talent.
Industry can do large-scale AI training, but little domain expertise and medical data.
With @MedARC_AI + @SophontAI, we hope to create a new environment for medical AI R&D that has the best of both worlds: plenty of compute, datasets, AI talent, and clinical expertise.
English