Bing Yan

50 posts

Bing Yan banner
Bing Yan

Bing Yan

@bingyan4science

AI+Chemistry PhD student @nyuniversity | Prev PhD of Chemistry @mit

New York Katılım Eylül 2017
483 Takip Edilen173 Takipçiler
Bing Yan retweetledi
Yuntian Deng @ ICML
Yuntian Deng @ ICML@yuntiandeng·
What if a website helper were a program tree, not a single chatbot? I built one for my course from 30 ProgramAsWeights programs. Each question falls through its own path of routing, search, answering, validation. Now anyone can ask a coding agent to build one with one prompt.
GIF
English
1
9
17
1.2K
Bing Yan retweetledi
Bing Yan retweetledi
Yuntian Deng @ ICML
Yuntian Deng @ ICML@yuntiandeng·
This is exactly the problem NeuralOS is targeting. We need the computer equivalent of a driving simulator. Our first step toward this: neural-os.com
GIF
Dwarkesh Patel@dwarkesh_sp

Here's a question I find confusing and interesting and which actually tells us a lot about the nature of current AI progress: Why has progress on computer use been so slow? Computer use is so clearly verifiable. I think the answer is that it is not enough for a domain to be verifiable. It also has to be very grindable—in the sense that you can run lots of parallel rollouts against a deterministic and replayable simulator. If you’re trying to make a model better at coding, you can create an environment that has a software repo with some missing feature that you’ve tasked the AIs with creating, and then you have a thousand parallel agents just go at the problem, each with their identical copy of the container. But this doesn’t work with computer use—at least not trivially. You can’t have a thousand agents go try the same checkout flow on Amazon. Because Andy Jassy will find and detect your bots and shut your ass down. How would we train an AI to build a business? How would you make an AI that’s really good at winning court cases? Or having a profitable day trading in the markets? Or helping a candidate win an election? What is the RL environment to make an AI as good at politics as Lyndon Johnson, or as good at building a space launch business as Elon Musk? The rollout requires interacting with the world and cannot be recreated simply within the datacenter. And the outer loop verification may take months or years of real world actions to elicit, and cannot be re-observed by perturbing the model’s actions thousands of times in parallel so that you can isolate what exactly the model did that actually worked.

English
3
4
22
3.4K
Bing Yan retweetledi
Kyunghyun Cho
Kyunghyun Cho@kchonyc·
seriously NYU's visitor registration portal based on JRNY sucksssssssssssss! i wasted so much time working with it every week. so ... here's a more modern, user friendlier version for you: install it on your browser with tampermonkey today. the link below. you're welcome, @nyuniversity !
Kyunghyun Cho tweet mediaKyunghyun Cho tweet media
English
7
5
29
8.1K
Bing Yan
Bing Yan@bingyan4science·
4/ What can we learn? In AI4Science, it is easy to fall into an incremental frame: "We applied method X to domain Y." A much more memorable frame shows insights behind the design: "What principle does the current model miss?" "We build the model around that principle."
English
1
0
0
21
Bing Yan
Bing Yan@bingyan4science·
Great Papers, Great Framing. #3 Electron Flow Matching for Generative Reaction Mechanism Prediction (2025) 1/ What is the frame? Mass conservation is a fundamental principle, is often violated in ML models. By modeling electron redistribution, FlowER explicitly satisfies it.
Bing Yan tweet media
English
1
0
2
80
Bing Yan
Bing Yan@bingyan4science·
4/ What can we learn? Great framing is not the most extreme claim. It is the one that best captures the mechanism. For GPT-3, the mechanism is: "as models scale, they are better at using context as task specification." The story is not size. The story is what size unlocks.
English
1
0
0
22
Bing Yan
Bing Yan@bingyan4science·
Great Papers, Great Framing. #2 Language Models are Few-Shot Learners (2020) (GPT-3) 1/ What is the frame? The frame is not: "We trained a bigger language model." The frame is: LLMs can adapt to new tasks through text interaction alone, without task-specific fine-tuning.
English
1
0
2
75
Bing Yan
Bing Yan@bingyan4science·
4/ What can we learn? Many great papers don't start with a better solution. They start by identifying an assumption everyone accepts. Then they ask: "What if that assumption is wrong?"
English
1
0
0
16
Bing Yan
Bing Yan@bingyan4science·
I'm starting a new series: Great Papers, Great Framing. I'll analyze 1 paper daily and ask 4 questions: -What is the frame? -Why is it powerful? -What is a weaker frame? -What can we learn? The goal is to learn how to tell a scientific story. #1 Attention Is All You Need
Bing Yan tweet media
English
1
0
2
69