brandon wang

398 posts

brandon wang

brandon wang

@fluorane

... | prev undergrad @miteecs and @mitbiology, @cartesia @janestreetgroup | usa imo 2019

california Katılım Nisan 2021
292 Takip Edilen1.2K Takipçiler
Sabitlenmiş Tweet
brandon wang
brandon wang@fluorane·
happy to announce that we've gotten rid of tokenizers! especially excited with what we've replaced them with: end-to-end trainable modules that not only learn to group characters into (sub)words, but can iterate to group words into phrases and further higher-order concepts see @sukjun_hwang's thread for more details 👇
Sukjun (June) Hwang@sukjun_hwang

Tokenization has been the final barrier to truly end-to-end language models. We developed the H-Net: a hierarchical network that replaces tokenization with a dynamic chunking process directly inside the model, automatically discovering and operating over meaningful units of data

English
12
50
760
77.7K
Oliver Ye
Oliver Ye@_isomerism·
am i the first person to run doom in chatgpt work mode
English
1
0
4
167
brandon wang
brandon wang@fluorane·
back then the usa ioi community was approximately the subset of the math olympiad community that was interested in coding/informatics (less true now, there is more specialization), e.g. basically everyone there went to mop, started out with mathcounts, etc. to your other point if you did imo you probably self-selected into a group that was not super into cs/more into pure math
English
1
0
39
1.4K
qt cache🪷
qt cache🪷@frontier_foid·
idk why people refer to their backgrounds as competitive math when most of the folks here were much better at ioi than imo (im actually not sure if any of them even went to the imo?). in fact, the best imo participants of this era haven't done much of note in ai!
Jesse Zhang@thejessezhang

x.com/i/article/2076…

English
4
0
123
21.1K
brandon wang
brandon wang@fluorane·
there's a lot of incentive to come up with RL algorithms that work on long-running tasks with complex outcomes (because autonomous ML research agents also require running long/expensive experiments etc.) so i feel like we'll get some pretty useful stuff soon will require doing smarter things than grpo family but seems not fundamentally limiting
English
1
0
2
177
Sanjay Srivatsan
Sanjay Srivatsan@SRsrivatsan·
While we're thinking about RL in bio -- biology won't have the immediate rewards that enabled coding agents. Even if you could instantaneously spin up an experiment, diffusion and cell division both place hard time bounds on speed. RL here will have through a massive number of simultaneous trajectories, with models forecasting time evolving states, and reward scored on achieving a desired end state.
English
7
1
72
6.2K
brandon wang
brandon wang@fluorane·
@NepalAadim > Theory is all about building a model that is predictive. this is a very physics-y perspective, people have spent centuries doing math for the love of the game and not for its predictive value
English
1
0
7
600
Aadim @ ICML 2026 🇰🇷
I feel like theory has no place in ML. SVMs and diffusion theory is the only proper cute math in ML, everything else is just philosophy. Theory is all about building a model that is predictive. Unfortunately, most ML theory is incapable of making predictions.
English
12
2
68
11.8K
Eli
Eli@elipughresearch·
We've been evaluating ink-2 on real voice-agent calls and measuring turn-taking performance, hard entity recall, and accuracy for diverse accents. Ink-2 is built with these things in mind, and it's amazing to see the difference they make in call quality.
English
2
0
4
91
brandon wang
brandon wang@fluorane·
@zacharylipton well anthropics complaints read more realpolitiky (it is bad for china to distill) than moral (distillation is theft)
English
0
0
4
539
Zachary Lipton
Zachary Lipton@zacharylipton·
AI companies complaining about distillation is the single greatest act of hypocrisy in the history of humanity.
English
19
60
561
43.1K
brandon wang retweetledi
Victor Li
Victor Li@victor_ljz·
We will be at ICML in Seoul to present dnaHNet in Oral + Poster sessions! Swing by and say hi if you wanna learn about the current SOTA in DNA foundation models :) Oral session: Hall D2 at 10 AM, Jul 7 Poster session: Hall A #900 at 2 PM, Jul 7
Arc Institute@arcinstitute

Most genomic AI models use fixed rules to process DNA into chunks, imposing arbitrary boundaries on a sequence with its own biological structure. @arnavshah0, @victor_ljz, and team developed dnaHNet, a tokenizer-free foundation model that learns its own segmentation from scratch, supervised by @_albertgu, @genophoria, and @BoWang87.

English
7
17
57
20K
brandon wang
brandon wang@fluorane·
i'm in korea for icml! come chat with me about doing cool new science with ai :)
English
3
0
49
2.6K
brandon wang
brandon wang@fluorane·
@KabirGoel bait posting for views/ugc has been so terrible for the information ecosystem
English
0
0
2
118
brandon wang
brandon wang@fluorane·
@unixpickle i feel like chemistry is in this weird space where in principle everything is deterministic (and thus simulate/compute-able) but in practice intractable. and so a lot of the game is finding useful approximations (mo theory, arrow pushing, your favorite reaction mechanism etc)
English
0
0
7
729
Alex Nichol
Alex Nichol@unixpickle·
I felt in high school chemistry like there were no useful or reusable abstractions, e.g. I couldn't actually predicting what molecules could exist / how they would behave from first principles, and it's all based on a ton of observations empirically -- is this actually true?
English
39
4
329
39.1K
brandon wang
brandon wang@fluorane·
@juli_li_ have you tried chatgpt image gen you can just link ur paper and tell it which figures to use
English
1
0
1
594
juliana
juliana@juli_li_·
how the ICML poster is going
juliana tweet media
English
17
7
400
19.3K
brandon wang
brandon wang@fluorane·
@_isomerism dont worry given the propensity to change naming styles so frequently im sure youll get a chance with 5.7
English
0
0
2
61
Ronald Yu
Ronald Yu@kylekalewale·
why is nobody talking about Cursor's insane instagram ABG ad campaign
English
54
22
989
166.5K