
CS used to be a relatively less toxic field because the tools were open and cheap. You could do meaningful research with a laptop, or maybe a single GPU. Those good old days are probably never coming back. (1/3)
Computational Sciences & Engineering
14.8K posts

@Computational_s
Magazine of #Computational Sciences • Engineering • Fluid Dynamics • #cfd | est. 2013 by @thepostdoctoral

CS used to be a relatively less toxic field because the tools were open and cheap. You could do meaningful research with a laptop, or maybe a single GPU. Those good old days are probably never coming back. (1/3)




Optimization theory for adaptive methods actually predicts most of what we know about hyperparameter scaling in LLM pretraining, and suggests new strategies as well. We did a deep dive here.











