
Ben Hamner
4.6K posts

Ben Hamner
@benhamner
Sumble co-founder and CTO. Learning high-quality, structured data about the world. Formerly @kaggle



"A decade ago, AI was supposed to replace radiologists. Today, radiologists make more than $500,000 per year, and their employment continues to grow, see chart below. Reading scans is a task, not a job, and when the task gets cheaper, demand for the job grows."



Interviewer: Your page loads in 80 ms in Australia but 600 ms in India. Same backend. Same code. What would you use to fix this?




All closed-source frontier labs use tons of open-source all over the stack, starting from python, @PyTorch, @huggingface all the way down to RoPE, GQA, flash-attention, or any tiny improvements released by open-source players. The whole transformers architecture (the T in gpT) comes from an open research paper and open-source model from 2017: huggingface.co/papers/1706.03… This is ok but would be much nicer if they would acknowledge the contributions & contribute back more!




Google is processing 980 trillion+ monthly tokens across our products and APIs (up from 480T in May) 🤯 No slowdown in sight, intelligence is everywhere.








