

New Turing Institute
44 posts

@newturing
Non-profit. Nurture and inspire the next generation of AI talents in Southeast Asia and beyond. Formerly VietAI https://t.co/ujRpQMJEuK.





























It felt like yesterday I was a 17yo at MIT Manipal who thought AI was more magic than math. Today, I shipped a first-of-its-kind backprop implementation that combines FlashAttention + GQA + SWA + Attention Sinks for GPT‑OSS : fully open source. Benchmarks: ~33× faster fine-tuning and ~138× more memory‑efficient vs naïve PyTorch, on the same hardware. Visuals attached. HuggingFace has FlashAttention support, but nothing close to this training efficiency/practicality existed…until now. Want to try it? Repo link:github.com/sunnnybala/gpt… run a finetune and tell me what breaks. Huge thanks to @lmthang, @longphan3110 for putting this problem on my radar, And big shoutout to the @newturing 's GStar team including @JeffDean , @YiTayML and everyone who helped along the way.


Had a great weekend being part of the GenAI summit in Vietnam. 😄 Really enjoyed the impressive talks by @jeffdean, @quocleix @lmthang and @Diyi_Yang, along with the nice panel discussion that we had. 😄 Meanwhile, one major unexpected highlight of this trip for me personally was meeting @PoShenLoh and watching his talk on math, education, game theory and changing the world. This man is built different and cracked. Really such a breath of fresh air admist all the AI hype. 😄 The production quality of the summit was super serious and high quality 👌. The energy of the local crowd really makes me feel that Vietnam is really serious about AI. 🫡 This is my first time in Vietnam and it was amazing to be hosted by @lmthang. On the second day we visited some universities and left me a strong impression about the culture there. People there seem hungry for learning and science/math and that is amazing. Enjoyed the trip and the great hospitality and thoughtfulness by the hosts and organizers. 👍 Nit: Vietnam needs more ACs though🥵🥵🥵



Glad to organize the 1st ever GenAI summit in Vietnam and welcome many great speakers from industry, academia, and startups. starting tomorrow, featuring @JeffDean in person for the first time in the region! Website: summit.newturing.ai