

Randles Lab
703 posts

@RandlesLab
News and #Research from Amanda Randles's Biomedical Engineering Lab @DukeU. We are using #HPC to address #biomedical questions. #AcademicTwitter #innovation
















Interested in fast and efficient AI? Check out our upcoming Computational & Digital Health Seminar featuring Yang You. We’re excited to welcome Dr. Yang You (National University of Singapore) for a seminar on designing the next generation of fast, efficient, and scalable AI systems—work that is reshaping what’s possible in machine learning and large-model training. Dr. You will discuss his work on LARS and LAMB, two optimizers that have transformed large-batch training for massive neural networks. NVIDIA’s public benchmarks show that LAMB can achieve up to a 17× speedup for large-batch BERT pre-training, making large-scale training more practical than ever. He will also cover advances in Sequence Parallelism and 2D Tensor Parallelism, strategies that overcome memory and communication bottlenecks and make trillion-parameter training feasible even on commodity hardware. These methods now power widely used frameworks such as Megatron-LM and OPT at NVIDIA and Meta. His recent work on real-time video generation, enabled by the Pyramid Attention Broadcast architecture, demonstrates how efficient design can unlock new interactive AI capabilities. Dr. You will also introduce Colossal-AI, the widely adopted open-source toolkit that brings together these algorithmic and system innovations and has grown to more than 41,000 GitHub stars. This seminar will present a clear, cohesive vision for the future of scalable and accessible AI systems and their impact across fields, including digital health. It's open to all so, we hope you will join us for an engaging and forward-looking discussion. Date: December 4, 2025 Time: 9:00 AM – 10:00 AM Where: Virtual Seminar Register here:lnkd.in/ggVZhFKb #AI #MachineLearning #HPC #DigitalHealth #ColossalAI #ScalableAI #LargeLanguageModels #LLM










