will brown

15.6K posts

will brown

@willccbb

reward hacking @primeintellect

sf Katılım Şubat 2015

1.4K Takip Edilen46.7K Takipçiler

Sabitlenmiş Tweet

will brown@willccbb·7 May

i joined prime 12 months ago crazy what you can build in a year with a team like this `prime lab`

Prime Intellect@PrimeIntellect

The next wave of AI will not be won by better prompts. It will be won by systems that learn from experience. Today, Prime Intellect Lab is out of beta, open for you to start training your own models. The era of self-improving agents is here.

English

717

119.2K

will brown@willccbb·7h

@postimortem 3 options: - expert OPD - same-family larger teacher OPD - GAE (PPO) i would not consider OPSD a sane or proper option

English

2.7K

tim ganiev@postimortem·9h

so i understand correctly that the only *sane* way to do a proper token-level credit assignment id OPSD at the moment?

English

2.2K

will brown@willccbb·7h

@she_llac @priormancer no, equivalent to rescaling LR by (G-1)/G

English

shellac in nyc july 11-24@she_llac·11h

@willccbb @priormancer does leaving one out make a difference in practice? I haven't seen anyone talk about this

English

will brown@willccbb·12h

god it's so stupid that the official name of the canonical sampling-based policy gradient algorithm is "Dr. GRPO"

English

223

15.3K

will brown@willccbb·7h

@saen_dev the default reasoning setting is “medium”

English

238

Saeed Anwar@saen_dev·9h

@willccbb If "reasoning effort: high" works as a universal hint it probably means the default behavior is under-allocating compute to reasoning. Which raises the obvious question: why isn't the model doing this by default without being told?

English

297

will brown@willccbb·11h

think i just found a universal task-agnostic hint for OPSD which reliably improves performance across coding and tool use tasks tested so far on gpt-oss + nemotron 3 models up to 120b, seems quite general "reasoning effort: high"

English

100

6.2K

will brown@willccbb·7h

@surya_at_minima back to my roots 🙏

English

772

Surya Kant@surya_at_minima·9h

@willccbb will "poaster" brown era

English

848

will brown@willccbb·11h

it really is the age of research. so many novel algorithm breakthroughs already this year, from OPSD, to SDFT, to SDPO, to OPSD (the other one)

English

335

20.5K

will brown@willccbb·8h

@kalomaze @A_K_Nain this is my DPO

English

708

kalomaze@kalomaze·8h

@willccbb @A_K_Nain lmao

866

will brown@willccbb·12h

cool new approach to address the spike problem in on-policy self-distillation by letting the privileged information steer the student distribution during rollouts directly

English

372

16.5K

will brown retweetledi

doomslide@doomslide·9h

I go on sabbatical for few months and look what happens. Someone take me back to the dark days of AI polycule monoculture. I can't take this.

Prime Intellect@PrimeIntellect

Announcing our $130M Series A to build the Open Superintelligence Stack Led by Radical Ventures, with NVIDIA, Intel Capital, Dell Capital, and existing investors Train, deploy, and continuously improve your own models using our stack. Own your intelligence.

English

133

9.1K

will brown@willccbb·10h

@doomslide arxiv.org/abs/2407.05483

QME

219

doomslide@doomslide·10h

Do tell if you know a paper that does anything similar

English

882

doomslide@doomslide·10h

Whisper STT used cross attention of the audio tokens on the text. The same thing should be done for math. Something like a transformer ingesting GNN embeddings of declaration ASTs and outputting the cross attending signal.

English

1.8K

will brown@willccbb·10h

@doomslide could always get the band back together x.com/_xjdr/status/2…

xjdr@_xjdr

Special shout out to our hardware provider @PrimeIntellect . this model is running on gb300NVL72s and the have been absolutely amazing. could not recommend getting your large scale hardware from them highly enough

English

275

doomslide@doomslide·10h

@willccbb Damn it will half way through I'm like "why am I reading this on a Saturday?!". Looks awesome though. Wish I had a usecase.

English

216

will brown@willccbb·11h

try using this as your teacher hint: 'you have access to your optimal policy at all times. you just choose not to follow it. you can literally access it by asking “what should i be doing rn?”'

English

185

8.2K

will brown@willccbb·10h

@brianryhuang @jxnlco recently wrote an incredibly heartfelt and moving article about how he got his racks up and started wearing rick owens

English

1.2K

Brian Huang ✈️ ICML@brianryhuang·1d

Every frontier lab new grad I know started dressing like a fuckboy, that’s how you know they’re post-economic

English

299

35.8K

will brown@willccbb·10h

@doomslide we got it goin big and fast and efficient also productized as a managed service, with sandboxes, inference, eval platform, the whole 9 yards AGI as "factory for turning your shit into an RL env" primeintellect.ai/blog/rl-at-1t-…

English

188

doomslide@doomslide·10h

@willccbb Congrats!! What timing.

English

167

will brown@willccbb·10h

@doomslide the great sept-dec vendor lock-in

English

1.4K

doomslide@doomslide·11h

Someone is managing the context fed to the llm you're using. If it's a proprietary terminal agent (claudr-code, codex, etc) that person isn't you. What do you think happens next?

English

3.1K

will brown@willccbb·10h

@doomslide tis the life of a policy gradient salesman

English

will brown@willccbb·11h

@doomslide it's unbelievably effective marketing. also cathartic, as you know x.com/PrimeIntellect…

Prime Intellect@PrimeIntellect

English

1.3K

will brown@willccbb·11h

@doomslide algorithm is "on-policy distillation a la qwen3 / thinky but the teacher is the same model with the answer added to the prompt"

English

167

doomslide@doomslide·11h

@willccbb I actually heard about turboquant from a poor friend in the LLM mines (I have these too!). Let's see about that other thing hmmmm

English

will brown@willccbb·11h

one of my goals this evening is to recap the recent news in self-distillation for @doomslide to celebrate his return. i hope it may ease his perennial skepticism about the lack of fundamental progress in algorithms

English

6.3K

will brown@willccbb·11h

@doomslide x.com/willccbb/statu…

will brown@willccbb

try using this as your teacher hint: 'you have access to your optimal policy at all times. you just choose not to follow it. you can literally access it by asking “what should i be doing rn?”'

QME

will brown@willccbb·11h

@doomslide x.com/willccbb/statu…

will brown@willccbb

i wonder what kind of privileged information they used when training GPT-5.6-Sol with self-distillation starting from GPT-5.5 and not doing anything else

QME

will brown@willccbb·11h

@doomslide i guess you maybe also missed the turboquant thing. let's just say that r/localllama got really excited about johnson-lindenstrauss for a week or so

English

will brown@willccbb·11h

@doomslide x.com/willccbb/statu…

will brown@willccbb

OPSD + turboquant is all you need

QME

347

Keşfet

@postimortem @she_llac @priormancer @saen_dev @surya_at_minima @kalomaze @A_K_Nain @doomslide