Alexandre Passos

1.7K posts

Alexandre Passos

Alexandre Passos

@atpassos_ml

Alexandre Passos' research-related twitter

San Francisco, CA Katılım Eylül 2010
185 Takip Edilen1.1K Takipçiler
Alexandre Passos retweetledi
William Fedus
William Fedus@LiamFedus·
Today, @ekindogus and I are excited to introduce @periodiclabs. Our goal is to create an AI scientist. Science works by conjecturing how the world might be, running experiments, and learning from the results. Intelligence is necessary, but not sufficient. New knowledge is created when ideas are found to be consistent with reality. And so, at Periodic, we are building AI scientists and the autonomous laboratories for them to operate. Until now, scientific AI advances have come from models trained on the internet. But despite its vastness — it’s still finite (estimates are ~10T text tokens where one English word may be 1-2 tokens). And in recent years the best frontier AI models have fully exhausted it. Researchers seek better use of this data, but as any scientist knows: though re-reading a textbook may give new insights, they eventually need to try their idea to see if it holds. Autonomous labs are central to our strategy. They provide huge amounts of high-quality data (each experiment can produce GBs of data!) that exists nowhere else. They generate valuable negative results which are seldom published. But most importantly, they give our AI scientists the tools to act. We’re starting in the physical sciences. Technological progress is limited by our ability to design the physical world. We’re starting here because experiments have high signal-to-noise and are (relatively) fast, physical simulations effectively model many systems, but more broadly, physics is a verifiable environment. AI has progressed fastest in domains with data and verifiable results - for example, in math and code. Here, nature is the RL environment. One of our goals is to discover superconductors that work at higher temperatures than today's materials. Significant advances could help us create next-generation transportation and build power grids with minimal losses. But this is just one example — if we can automate materials design, we have the potential to accelerate Moore’s Law, space travel, and nuclear fusion. We’re also working to deploy our solutions with industry. As an example, we're helping a semiconductor manufacturer that is facing issues with heat dissipation on their chips. We’re training custom agents for their engineers and researchers to make sense of their experimental data in order to iterate faster. Our founding team co-created ChatGPT, DeepMind’s GNoME, OpenAI’s Operator (now Agent), the neural attention mechanism, MatterGen; have scaled autonomous physics labs; and have contributed to some of the most important materials discoveries of the last decade. We’ve come together to scale up and reimagine how science is done. We’re fortunate to be backed by investors who share our vision, including @a16z who led our $300M round, as well as @Felicis, DST Global, NVentures (NVIDIA’s venture capital arm), @Accel and individuals including @JeffBezos , @eladgil , @ericschmidt, and @JeffDean. Their support will help us grow our team, scale our labs, and develop the first generation of AI scientists.
William Fedus tweet media
English
427
441
4.2K
3.5M
Aurélien Geron
Aurélien Geron@aureliengeron·
Variables don't support item assignment in @TensorFlow today. Perhaps something to fix in TF 2.0?
Aurélien Geron tweet media
English
5
3
14
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@dwf I hate the premise that installing an app makes users more engaged. Confounds correlation with causation
English
1
1
2
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@ogrisel the adagrad paper has the derivation. I'm still at Google, doing ml stuff. Just hadn't checked twitter in a while :-)
English
0
0
0
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@ogrisel well, it's there because the derivation involved a two-norm as it came from online regret bounds.
English
1
0
1
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@milesosborne I hate it when people do. Tes vary by orders of magnitude depending on cleverness of implementation and HW.
English
1
0
0
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@leonpalafox I love the many explanations of common techniques, as each paper needs to reframe prior work to make its ideas understood
English
0
0
0
0
Alexandre Passos retweetledi
Beau Cronin
Beau Cronin@beaucronin·
ICYMI: The business models being adopted by the new crop of deep learning startups, and the challenges of each. npbay.es/deep-learning-…
English
4
11
6
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@johnmyleswhite otoh you could argue that in CS all good replication is conceptual, since the same code on the same data can't tell you news
English
1
0
1
0
Alexandre Passos
Alexandre Passos@atpassos_ml·
@mdreid what do you get if you cross a self referential joke with a rhetorical question?
English
0
0
1
0
Alexandre Passos retweetledi
ML Hipster
ML Hipster@ML_Hipster·
This ML algorithm is rated R. It contains: Strong Assumptions, Frequent Sampling, and Matrix Inversions. Restricted to masochistic users.
English
0
69
81
0
Alexandre Passos retweetledi
John Myles White
John Myles White@johnmyleswhite·
I finally made a point to learn how Johnson-Lindenstrauss Lemma projections work and wrote up a quick description: bit.ly/1iUHp23
English
5
17
21
0