John Tian

Actually a great question; I was working on my own chess benchmark a couple weeks ago and I measured the number of moves top models could make against Stockfish in a random position that's equal (+-0.5 centipawns) given the legal move options every turn. If I recall correctly, top models like 3.1 Pro were making it 10-20 moves before losing via checkmate. I couldn't continue and publish my results due to it becoming prohibitively expensive, unfortunately.

@johnrtian Are current LLMs good at Chess and Go? I wonder if we benchmark those? Answering my own question: reddit.com/r/ChatGPTPro/c…

here's the pr for anyone curious: github.com/openai/paramet…

got a bpb of 1.26 with JEPA! for context: every single entry on the parameter golf leaderboard is a GPT. this is a JEPA encoder-decoder that predicts latent representations, not next tokens. it uses a pure byte-level tokenizer (vocab 260 vs 1024 BPE). there's no tokenizer: the model has to learn everything from raw bytes. even with untuned hyperparams, it's within 0.04 bpb of the GPT baseline. the gap to close is small and i have a ton of ideas about how to beat it! (would love some credits)

@crierlon Long story

T3 Code now supports Claude. If you have the Claude Code CLI installed and signed in, you can use it with T3 Code. Hopefully the lawyers won't make us remove this 🙃

@jonathanzliu @heyruchir ohh... what's ur churn %?

@heyruchir LTV per subscriber is $21 so my CAC needs to be below that

just burned $1.4k on paid ads and only made ~$600 back to organic it is

@heyruchir @jonathanzliu yeppp! a CAC of $46 is not bad at all if the app is sticky

@jonathanzliu What’s your LTV for every subscriber? If it’s high enough than this is worth it.

@angehyc the colors are pristine

@0xajka @theo @t3dotchat pretty sure @r_marked added it!

@theo “Wait Sonnet 4.6 dropped?” as if you didn’t already have it available on @t3dotchat

@theo exa instant for the win!

@theo It's genuinely so evil that I have to believe it's ragebait..