Nicholas Sofroniew
5.1K posts
@sofroniewn
math/neuroscience - AI
A statement on the comments from Secretary of War Pete Hegseth. anthropic.com/news/statement…
We're thrilled to present ESM3 in @ScienceMagazine. ESM3 is a generative language model that reasons over the three fundamental properties of proteins: sequence, structure, and function. Today we're making ESM3 available free to researchers worldwide via the public beta of an API for biological intelligence. Trained with over a trillion teraflops of compute, this is the first time a model of this scale has been trained for biology, pushing the frontier of AI for biological discovery and engineering. ESM3 learns to represent the immense complexity of protein biology, learning from billions of natural proteins. From this training it developed the capability to design proteins, responding to complex prompts combining atomic level details and high level instructions to generate new proteins. ESM3 can explore protein space far beyond natural evolution. We prompted ESM3 to generate a fluorescent protein at a far distance from any known fluorescent proteins, searching an unknown region of protein space, to discover a new fluorescent protein. We estimate this is equivalent to simulating five hundred million years of evolution.
Introducing ESM Cambrian. Unsupervised learning can invert biology at scale to reveal the hidden structure of the natural world. We’ve scaled up compute and data to train a new generation of protein language models. ESM C defines a new state of the art for protein representation learning.
Great fireside chat with @geochurch and @alexrives moderated by @johncumbers here at AI🧬BTO East at @MIT! 1) 3D printing with trillions of printers and billions of inks - what is that? That’s 1 mm^3 of cells assembling products!!! That’s the power of biology - thank you @geochurch for the metaphor
