Ingmar Kanitscheider

@LiamFedus @ekindogus @periodiclabs Congrats on the launch!

Today, @ekindogus and I are excited to introduce @periodiclabs. Our goal is to create an AI scientist. Science works by conjecturing how the world might be, running experiments, and learning from the results. Intelligence is necessary, but not sufficient. New knowledge is created when ideas are found to be consistent with reality. And so, at Periodic, we are building AI scientists and the autonomous laboratories for them to operate. Until now, scientific AI advances have come from models trained on the internet. But despite its vastness — it’s still finite (estimates are ~10T text tokens where one English word may be 1-2 tokens). And in recent years the best frontier AI models have fully exhausted it. Researchers seek better use of this data, but as any scientist knows: though re-reading a textbook may give new insights, they eventually need to try their idea to see if it holds. Autonomous labs are central to our strategy. They provide huge amounts of high-quality data (each experiment can produce GBs of data!) that exists nowhere else. They generate valuable negative results which are seldom published. But most importantly, they give our AI scientists the tools to act. We’re starting in the physical sciences. Technological progress is limited by our ability to design the physical world. We’re starting here because experiments have high signal-to-noise and are (relatively) fast, physical simulations effectively model many systems, but more broadly, physics is a verifiable environment. AI has progressed fastest in domains with data and verifiable results - for example, in math and code. Here, nature is the RL environment. One of our goals is to discover superconductors that work at higher temperatures than today's materials. Significant advances could help us create next-generation transportation and build power grids with minimal losses. But this is just one example — if we can automate materials design, we have the potential to accelerate Moore’s Law, space travel, and nuclear fusion. We’re also working to deploy our solutions with industry. As an example, we're helping a semiconductor manufacturer that is facing issues with heat dissipation on their chips. We’re training custom agents for their engineers and researchers to make sense of their experimental data in order to iterate faster. Our founding team co-created ChatGPT, DeepMind’s GNoME, OpenAI’s Operator (now Agent), the neural attention mechanism, MatterGen; have scaled autonomous physics labs; and have contributed to some of the most important materials discoveries of the last decade. We’ve come together to scale up and reimagine how science is done. We’re fortunate to be backed by investors who share our vision, including @a16z who led our $300M round, as well as @Felicis, DST Global, NVentures (NVIDIA’s venture capital arm), @Accel and individuals including @JeffBezos , @eladgil , @ericschmidt, and @JeffDean. Their support will help us grow our team, scale our labs, and develop the first generation of AI scientists.

If European countries were smart they'd put up billboards in SF right now.

Our open models are here. Both of them. openai.com/open-models

It's deeply concerning that one of the best AI researchers I've worked with, @kaicathyc, was denied a U.S. green card today. A Canadian who's lived and contributed here for 12 years now has to leave. We’re risking America’s AI leadership when we turn away talent like this.

@_aidan_clark_ We're clearly in need of a reorg.

Update #2: surprisingly I’ve had two good ideas while here which I think means OAI needs to move model training operations.

@_aidan_clark_ Don't you sometimes get the best ideas when deprived of oxygen?

Update: I know where *isn’t* a good place to do ML researcher….

@sama Congrats!

welcome to the world, little guy! he came early and is going to be in the nicu for awhile. he is doing well and it’s really nice to be in a little bubble taking care of him. i have never felt such love.

Bernard Arnault could make the EU relevant in AI capabilities for a small fraction of his net worth. Similarly for a few European billionaires pooling their $ together. The fact that they don’t, and governments don’t either, is interesting.

OpenAI o3-mini is now available in ChatGPT and the API. Pro users will have unlimited access to o3-mini and Plus & Team users will have triple the rate limits (vs o1-mini). Free users can try o3-mini in ChatGPT by selecting the Reason button under the message composer.

@euacchq @noverloop @andreasklinger As an Austrian, I very much hope that they won’t succeed in torpedoing your initiative.

Exactly. That’s why we need a counter narrative. We should not underestimate them. We need Austrians who speak up Btw, where is this from? Notes: 1- They somehow digitalized against their will due to directive 2019/1151 2- then they should share the percentage of digital, not in person signatures (like docusign). All notary chambers we asked refused to share data.

@andreasklinger @euacchq IT BEGINS! Austrian Notary association is clearly in denial that they repel investment and are the main cause of painful bureaucracy

If you’re a researcher and not thinking about how AI could increase your productivity now + in the future, you should start doing so. Varies by field but illustratively, you should think ~2-100x bigger over the next 3 years (compared to what you could have achieved without AI).

OpenAI o1 is now out of preview in ChatGPT. What’s changed since the preview? A faster, more powerful reasoning model that’s better at coding, math & writing. o1 now also supports image uploads, allowing it to apply reasoning to visuals for more detailed & useful responses.

@XiaohuaZhai @OpenAI @giffmana @__kolesnikov__ Welcome!

Life update📢: After an amazing decade at Google/DeepMind, I’m thrilled to announce that I’ll be joining @OpenAI in a few weeks! I’m excited for the opportunity to co-build the OpenAI Zürich office alongside my close collaborators @giffmana and @__kolesnikov__ 🚀

@lilianweng Congrats on an amazing run! We will miss you!

After working at OpenAI for almost 7 years, I decide to leave. I learned so much and now I'm ready for a reset and something new. Here is the note I just shared with the team. 🩵

This sounds like a great initiative. I would love to see Europe to be more competitive in tech and AI.

We're releasing a preview of OpenAI o1—a new series of AI models designed to spend more time thinking before they respond. These models can reason through complex tasks and solve harder problems than previous models in science, coding, and math. openai.com/index/introduc…

Majorly improved GPT-4 Turbo model available now in the API and rolling out in ChatGPT.

@RogerGrosse I'm a big fan of investigations that try to deeply understand how things work. But I worry that if industry researchers exclusively focused on deep understanding, no big LLM would ever get trained.

I'll turn this around and ask how our field got into a state where understanding how things work needs a special name like "mech interp" or "science of DL", rather than just being something researchers do every day. Part of MI's appeal is that it's just closer to what most AI researchers would be doing absent incentives to the contrary.

Restricting dual citizenship is such a pointless bureaucratic hurdle. Kudos to the German government for finally abolishing this restriction and embracing dual nationality.

@drjwrae Congrats, Jack!

Gemini 1.0 is out! Trained across images, audio, video and text. Advances the state of the art across many modalities. E g. MMLU is in the >90% club. Everything in one model is so back. Plus a super fun team to work with 💙