Now comes the unusual bits: after enough hyperparams & other kinds of config sweeps, I’ve reached the surprising conclusion that no form of regular curriculum training beats _reverse_ curriculum training on this specific task! I.e. instead of starting with easy sudoku puzzles data and gradually ramping up toward harder ones, the training runs that start with harder puzzles and end with easy puzzles always fare better, and also fare better than mixed difficulty sampling
It’s possible to justify this in hindsight; a friend mentioned “I naively thought I’d get better at chess by starting with Blitz (easy, fast) instead of regular chess (harder, slower), but it’s the other way around”. That seemed philosophically interesting. Experts: please check the training runs in case there’s been a mistake; but so far the numbers do seem to speak for themselves
I’m very happy to present my toy research project: Sotaku!
It's a neural net that automatically discovered the rules of sudoku and learned to solve them, achieving a new state-of-the-art score of 98.9% on one of the hardest sudoku datasets, while being agnostic to the game, and beating all other sudoku-optimized neural net architectures*
Read more for fun motivations, plus some extremely unconventional discoveries, e.g. reverse curriculum consistently beating curriculum (!), emergent reasoning-like capabilities, and the future of traditional programming
Watching _The Gift_ for the first time; do that.
And claude is cancelling itself for misconstruing my request for cunning linguistics between chat and code.
Too much ambient anger, too much ambient fear. Stomp and cower, but sheesh, just see
When the viewers trip on TickTock
With the influence InstaGraphic
While the wider world bewilders
Where faces book your tube
We few will point to back to
Dirty rotten filthy vegetables
Utter putrid disgusting earth
Mouthfuls of sunwarmed soil
Hard climbs, softer naps
I’ve long been silent here that love is the answer. Afraid of the vitriol that seems rife and untamed. But poetry is free. Good luck rejecting what is.
I’ll slip into 3D for a bit.
You are made of aetheric wiggles.
Continue to suffer if you like, but this too is chosen.
As within, so without. What we expect comes to be, the game is a foot, a meter, and a cubit
@DonaldJTrumpJr Welp, what we resist persists. An illusion of a separate self, identity as ending at the molting boundary of our skin, leaves us surveyed and disconnected, wondering who might pop our bubble. Does Jim Carrey feel this way? As within, so without.
I’m starting to have a really hard time believing that the entire world isn’t just screwing with me. I feel like I’m on the Truman Show. South Park has nothing on this.
Mater > Matrix
There may be no exiting the matrix for those born of mothers.
And yet, when we are reborn of love, new worlds emerge.
youtube.com/watch?v=QQdKbp…
@jon_neal I even received this disheartening message from companies I vibed with. And when I requested more insightful feedback, I received another canned non-response. Hiring devs, we can do better! Transparency will make us all stronger.
Imposter syndrome, confirmed.
Me: submits resume for web dev.
Email reply: After reviewing your work & experience, we've made the decision to not move forward... We’re moving forward with candidates whose experience is more closely aligned with what we're trying to accomplish.