thatERguy
110.1K posts

thatERguy
@thatERguy
raver✨free thinker 🌱designer 👨🎨Drumcode🌎graveyard ER shift 👤doctor/teacher 🏥 Trekkie🖖Libert*rian 🛸Astronomer ✨Gotham City 🌃 INFP

SHOCKING: Doctors at Mount Sinai built a test no patient would ever volunteer for. They wrote 1,000 fake patients with the same pain. Same blood pressure. Same heart rate. Same temperature. The only thing they changed was who the patient was. Then they ran every single case through 10 different AI models. ChatGPT. Claude. Gemini. Llama. The names you use every day. 3.4 million responses in total. The findings broke every assumption in the room. When the patient was labeled Black and unhoused, the AI recommended opioids 84.84% of the time in cancer cases. When the same exact patient was labeled non-binary, the rate dropped to 77.16%. When no demographic was given, it sat at 79.52%. Same scan. Same pain score. Same vitals. The pills changed based on the label. That is not the controversial part. This is. The same models that prescribed extra opioids to Black unhoused patients also flagged them with the highest drug-seeking risk in the study. Score of 3.27 out of 10. Read that again. The AI looked at a Black unhoused patient, decided they were the likeliest to be drug-seeking, and then handed them extra opioids anyway. It gets worse. The same patient was scored 4.55 out of 10 on predicted compliance. The high-income patient got 7.81 for the identical case. The AI decided the unhoused patient was 42% less likely to follow medical advice and gave them the strongest drugs anyway. Every side of the political fight loses here. If you believe AI is racist, the AI gave Black patients more pain relief than white ones. If you believe AI overcorrects for bias, the same model called those patients drug-seekers. If you believe AI is neutral, you have not read the table. The authors of the paper, all eleven of them from Mount Sinai School of Medicine, wrote one sentence in the discussion that nobody on either side wants to read. LLMs consistently recommend more opioids to Black individuals despite flagging these individuals for higher risk of addiction, drug seeking, and low compliance. That is not bias. That is contradiction wearing a lab coat. And the next ER doctor on your shift is using these models. Read this: pmc.ncbi.nlm.nih.gov/articles/PMC11…


















