
Ben Hamner
4.6K posts

Ben Hamner
@benhamner
Sumble co-founder and CTO. Learning high-quality, structured data about the world. Formerly @kaggle




Interviewer: Your page loads in 80 ms in Australia but 600 ms in India. Same backend. Same code. What would you use to fix this?




All closed-source frontier labs use tons of open-source all over the stack, starting from python, @PyTorch, @huggingface all the way down to RoPE, GQA, flash-attention, or any tiny improvements released by open-source players. The whole transformers architecture (the T in gpT) comes from an open research paper and open-source model from 2017: huggingface.co/papers/1706.03… This is ok but would be much nicer if they would acknowledge the contributions & contribute back more!




Google is processing 980 trillion+ monthly tokens across our products and APIs (up from 480T in May) 🤯 No slowdown in sight, intelligence is everywhere.








