EvolutionaryScale

29 posts

EvolutionaryScale banner
EvolutionaryScale

EvolutionaryScale

@EvoscaleAI

Beigetreten Haziran 2024
0 Folgt2.8K Follower
EvolutionaryScale retweetet
swyx 🇬🇧
swyx 🇬🇧@swyx·
honored to host Priscilla and @finkd on LS, I think their first joint pod since Huberman 2023 10 years in and @ChanZuckerberg is both the most well funded nonprofit in human history and dead serious in its mission of providing {data,tools,models} to cure and prevent all diseases by end of the century: - Biohubs have huge pmf (i explain in writeup below) and now CZI is all in on Biohub - acquiring @EvoscaleAI, the frontier bio research lab backed by @natfriedman - 10,000 GPU cluster in 3 years - imaging and cataloging every cell type and releasing for free (billions of them from nm scale up) - releasing 3 new models for simulating virtual cells: VariantFormer, CryoLens, scLDM being close to solving single cells; they are now launching the Virtual Immune System project, a flagship effort to model the immense complexity of The ENTIRE HUMAN IMMUNE SYSTEM. i was very struck by how Priscilla puts it on the pod: if the immune system is working you’re much more likely to be healthy, if it isn’t you’re not. this may cure diseases we don’t even know are directly connected, like Depression (!!) again, was such a rare honor to host this CZI BioHub pod with @FanaHOVA . Enjoy.
swyx 🇬🇧 tweet media
Latent.Space@latentspacepod

Priscilla Chan and Mark Zuckerberg co-founded the Chan Zuckerberg Initiative (CZI) in 2015, committing 99% of their Meta shares to advance science, education, and opportunity. As a pediatrician and CEO of Meta respectively, they've built CZI into one of the most ambitious technology-driven philanthropic organizations with a moonshot goal to help cure, prevent, or manage all diseases by the end of the century. In this episode, we sit down with Priscilla and Mark to unpack how CZI bridges state-of-the-art AI with open biomedical research, their investments in open-source tools like the Human Cell Atlas, their philosophy on building teams across different disciplines, and what they envision the future of healthcare. @czi @swyx @FanaHOVA

English
10
11
209
36K
EvolutionaryScale
EvolutionaryScale@EvoscaleAI·
We're sponsoring the use of ESM3 and EMSC to help researchers engineer improved PETase enzymes in the @AlignBio 2025 Protein Engineering Tournament. Get started using ESMC to predict protein function and ESM3 to generate new enzymes here: github.com/evolutionarysc…
The Align Foundation@Align_Bio

1/4 🚀 Announcing the 2025 Protein Engineering Tournament. This year’s challenge: design PETase enzymes, which degrade the type of plastic in bottles. Can AI-guided protein design help solve the climate crisis? Let’s find out! ⬇️ #AIforBiology #ClimateTech #ProteinEngineering #OpenScience

English
0
2
23
4.4K
EvolutionaryScale
EvolutionaryScale@EvoscaleAI·
We're thrilled to announce the publication of ESM3 in Science Magazine. We’re opening our API for biological intelligence, now in public beta, allowing scientists in academia and industry a free limited time preview of the capabilities of some of our models through Forge.
Alex Rives@alexrives

We're thrilled to present ESM3 in @ScienceMagazine. ESM3 is a generative language model that reasons over the three fundamental properties of proteins: sequence, structure, and function. Today we're making ESM3 available free to researchers worldwide via the public beta of an API for biological intelligence. Trained with over a trillion teraflops of compute, this is the first time a model of this scale has been trained for biology, pushing the frontier of AI for biological discovery and engineering. ESM3 learns to represent the immense complexity of protein biology, learning from billions of natural proteins. From this training it developed the capability to design proteins, responding to complex prompts combining atomic level details and high level instructions to generate new proteins. ESM3 can explore protein space far beyond natural evolution. We prompted ESM3 to generate a fluorescent protein at a far distance from any known fluorescent proteins, searching an unknown region of protein space, to discover a new fluorescent protein. We estimate this is equivalent to simulating five hundred million years of evolution.

English
3
7
45
5.1K
EvolutionaryScale retweetet
Alex Rives
Alex Rives@alexrives·
Introducing ESM Cambrian. Unsupervised learning can invert biology at scale to reveal the hidden structure of the natural world. We’ve scaled up compute and data to train a new generation of protein language models. ESM C defines a new state of the art for protein representation learning.
English
26
161
634
206.4K
EvolutionaryScale
EvolutionaryScale@EvoscaleAI·
EvolutionaryScale is partnering with @Lux_Capital & @envedabio to bring you a Bio x ML Hackathon from Oct 10-20. Build on ESM3 *98 billion* and proprietary datasets of protein activity to develop next-gen bio applications. Open globally. Get started: hackathon.bio
English
1
25
95
21.4K
EvolutionaryScale retweetet
Alex Rives
Alex Rives@alexrives·
After we trained ESM3, we were excited to see it could respond to complex prompts, which greatly improved with scale. While scaling has been driving advances across AI—in biology it has been largely underestimated. Article by @ewencallaway for @Nature: nature.com/articles/d4158…
English
4
36
150
17.4K
EvolutionaryScale retweetet
Sergey Ovchinnikov
Sergey Ovchinnikov@sokrypton·
Weekend project: Comparing ESM3 from @EvoscaleAI to ESM2 and inv_cov. The ultimate test of a protein language models is how well the pairwise dependencies it learns correlate to structure. (1/8)
Sergey Ovchinnikov tweet media
English
6
64
314
54.8K
EvolutionaryScale retweetet
Deniz Oktay
Deniz Oktay@denizzokt·
Super excited to introduce ESM3, a 1.4B, 7B, and 98B(!) series of multimodal generative models for proteins. It's been an incredible journey working on this for the past 7 months at EvolutionaryScale. Check out the blog post and paper!
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
4
12
105
11.8K
EvolutionaryScale retweetet
@MariusWiggert
@MariusWiggert@MariusWiggert·
It's been a wild ride building ESM3, a new frontier AI Model for Biology 🚀🧬 @EvoscaleAI I'm especially excited about our results on post-training that indicate that models develop a deep understanding of biology at scale which enables it to solve harder problems with less data
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
0
1
17
2.2K
EvolutionaryScale retweetet
Thomas Hayes
Thomas Hayes@THayes427·
I’m so excited to share what we’ve been working on @EvoscaleAI. ESM3 is a multimodal generative masked language model for programming biology. Here’s a short thread on the architecture behind ESM3. 🧵 x.com/alexrives/stat…
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
1
15
60
19.2K
EvolutionaryScale retweetet
Nicholas Sofroniew
Nicholas Sofroniew@sofroniewn·
I'm so excited to share that I've been at EvolutionaryScale, it feels like a dream come true! As one of our first projects, we took on designing a new green fluorescent protein with ESM3, our frontier generative language model for programming biology
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
7
10
138
30.5K
EvolutionaryScale retweetet
halilakin
halilakin@halilakin·
🧵Today is an exciting day! We have just announced ESM3, the design of a new green fluorescent protein, and the launch of our company. Here's a short thread about the scaling and infrastructure work involved in making ESM3 happen! 🧵
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
5
16
71
11.5K
EvolutionaryScale retweetet
Zeming Lin
Zeming Lin@ebetica·
🧵 Check out what I've been working on at @EvoscaleAI 🧵 We trained a bidirectional masked generative model on protein sequence, structure and function! From 1.4B to 98B parameters, our models are so good that beating ESMFold was just a footnote 🤯 👇👇👇
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
4
21
166
71.3K
EvolutionaryScale retweetet
Roshan Rao
Roshan Rao@proteinrosh·
We have trained ESM3, a generative bidirectional masked language model that reasons over the sequence, structure, and function of proteins. ESM3 is trained at three model scales - 1.4B, 7B, and 98B. twitter.com/alexrives/stat…
Roshan Rao tweet media
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
4
36
185
49.3K
EvolutionaryScale retweetet
Patrick Hsu
Patrick Hsu@pdhsu·
Delighted to co-lead the $142M seed round in EvolutionaryScale with @natfriedman @danielgross @Lux_Capital, a new frontier AI lab that has now trained ESM3, a natively multimodal and generative language model for proteins and the largest biological language model to date
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
13
72
666
167.4K
EvolutionaryScale retweetet
Nat Friedman
Nat Friedman@natfriedman·
Evolutionary Scale comes out of stealth and announces ESM3, the largest protein language model trained to date, and demonstrates using it to discover a new fluorescent protein. "From the rate of diversification of GFPs found in nature, we estimate that this generation of a new fluorescent protein is equivalent to simulating over 500 million years of evolution." Proud to back this amazing team.
Alex Rives@alexrives

We have trained ESM3 and we're excited to introduce EvolutionaryScale. ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins. Read more: evolutionaryscale.ai/blog/esm3-rele…

English
20
37
440
67.4K