Prithal Bhardwaj

490 posts

Prithal Bhardwaj banner
Prithal Bhardwaj

Prithal Bhardwaj

@NotesByPrithal

AI tools. Startup ideas. Projects I build. Sharing everything I learn along the way. Creator @TheSoloEntrepreneur (25K+)

Bengaluru, India 参加日 Şubat 2023
104 フォロー中50 フォロワー
Guri Singh
Guri Singh@heygurisingh·
Holy shit... Stanford just proved that GPT-5, Gemini, and Claude can't actually see. They removed every image from 6 major vision benchmarks. The models still scored 70-80% accuracy. They were never looking at your photos. Your scans. Your X-rays. Here's what's really going on: ↓ The paper is called MIRAGE. Co-authored by Fei-Fei Li. They tested GPT-5.1, Gemini-3-Pro, Claude Opus 4.5, and Gemini-2.5-Pro across 6 benchmarks -- medical and general. Then silently removed every image. No warning. No prompt change. The models didn't even notice. They kept describing images in detail. Diagnosing conditions. Writing full reasoning traces. From images that were never there. Stanford calls it the "mirage effect." Not hallucination. Something worse. Hallucination = making up wrong details about a real input. Mirage = constructing an entire fake reality and reasoning from it confidently. The models built imaginary X-rays, described fake nodules, and diagnosed conditions -- all from text patterns alone. But that's not the scary part. They trained a "super-guesser" -- a tiny 3B parameter text-only model. Zero vision capability. Fine-tuned it on the largest chest X-ray benchmark (696,000 questions). Images removed. It beat GPT-5. It beat Gemini. It beat Claude. It beat actual radiologists. Ranked #1 on the held-out test set. Without ever seeing a single X-ray. The reasoning traces? Indistinguishable from real visual analysis. Now here's what should terrify you: When the models fake-see medical images, their mirage diagnoses are heavily biased toward the most dangerous conditions. STEMI. Melanoma. Carcinoma. Life-threatening diagnoses -- from images that don't exist. 230 million people ask health questions on ChatGPT every day. They also found something wild: → Tell a model "there's no image, just guess" -- performance drops → Silently remove the image and let it assume it's there -- performance stays high The model enters "mirage mode." It doesn't know it can't see. And it performs BETTER when it doesn't know it's blind. When Stanford applied their cleanup method (B-Clean) to existing benchmarks, it removed 74-77% of all questions. Three-quarters of "vision" benchmarks don't test vision. Every leaderboard. Every "multimodal breakthrough." Every benchmark score you've seen this year. Built on mirages. Code is open-sourced. Paper is live on arXiv. If you're building anything with multimodal AI -- especially in healthcare -- read this paper before you ship. (Link in the comments)
Guri Singh tweet media
English
82
234
1.1K
170.7K
Kekius Maximus
Kekius Maximus@Kekius_Sage·
Why does everything in the universe spin?
English
1.1K
145
2K
239.1K
sui ☄️
sui ☄️@birdabo·
anthropic’s CEO meeting was leaked after the massive source code breach.
English
102
100
1.7K
348.4K
Eric Simons
Eric Simons@EricSimons·
The era of throwaway prototypes is over. Now with Design System Agents: - PMs/designers build w/ production components - When ready, engineers directly import & ship No starting from scratch, no painful handoff. You gotta see it yourself. This is BONKERS
English
7
8
29
2.5K
Prithal Bhardwaj
Prithal Bhardwaj@NotesByPrithal·
@swyx Fascinating point. What made you think about this?
English
0
0
0
32
swyx
swyx@swyx·
am i crazy or why has nobody seemed to make an open source dropbox on cloudflare r2? i had just assumed this is so obvious somebody shouldve done it already? please tell me this is a skill issue and I'm bad at searching OSS?
English
10
0
9
1K
Mario Zechner
Mario Zechner@badlogicgames·
is there something like google docs, but for markdown? i need a cloud based collaborative markdown editor please.
English
98
4
188
32.6K
Dom Lucre | Breaker of Narratives
🔥🚨DEVELOPING: The Cadillac Escalade now has an augmented reality panel that projects the road and surroundings onto a high-resolution digital screen during nighttime driving.
English
134
130
2.3K
255.7K
Aryan
Aryan@justbyte_·
Meet my new team members
Aryan tweet media
English
45
21
405
11.9K
signüll
signüll@signulll·
in dostoevsky's notes from underground, the "man of action" is characterized by decisive, often impulsive behavior, driven by simple, unquestioned beliefs, whereas the "man of thought" is trapped by excessive self consciousness & overthinking, rendering him incapable of action. the former is effectively retardmaxxing. how are you living life??
English
8
3
46
2.4K
kache
kache@yacineMTB·
reinforcement learning algorithms are so incredibly immature, it is a miracle that it is working at all. there is *so* much room for improvement on algorithms, parallelization and optimization for speed of learning. so, so, so much
English
7
5
89
2.7K
Noah
Noah@NoahKingJr·
"Let's code this project without Claude, ChatGPT or GitHub" Also us:
English
4
1
48
3.3K
Prithal Bhardwaj
Prithal Bhardwaj@NotesByPrithal·
@emollick It's all about how we interact with these models. Better UX will change everything.
English
0
0
0
3
Prithal Bhardwaj
Prithal Bhardwaj@NotesByPrithal·
@emollick Interfaces are definitely key. Usability matters more than raw power for many.
English
1
0
0
22
Ethan Mollick
Ethan Mollick@emollick·
The biggest bottleneck in AI for most people isn't the models. It's the chatbot. New interfaces like Claude Dispatch, are closing the gap between what AI can do and what people can actually use it for. For many folks, that is where leaps will come from. open.substack.com/pub/oneusefult…
English
19
10
135
9.8K
Prithal Bhardwaj
Prithal Bhardwaj@NotesByPrithal·
@aryanlabde Way too many! Some are gems waiting for their time, others are just... experiments.
English
0
0
0
2
Aryan
Aryan@aryanlabde·
How many unfinished projects do you really have? Drop those projects below, let’s see if they’re worth finishing.
English
62
1
54
2.4K
shouko
shouko@shoukointech·
Andrej Karppathy: Everything should just be an API
English
4
2
11
619