Roan
2.4K posts

Roan
@RohOnChain
building my life around quant systems in prediction markets and crypto










Andrej Karpathy builds GPT from scratch in one 2-hour video - before he led pretraining at Anthropic: he starts with an empty file and tiny Shakespeare, and ends generating infinite fake Shakespeare, character by character - the exact same way ChatGPT runs, just token by token. "now we get to the crux of self-attention - this is probably the most important part of this video." then he explains the whole engine: every token emits a query (what am I looking for) and a key (what do I contain), and attention is just them finding each other. by the end he connects it to the real thing: "to train ChatGPT there are roughly two stages: pre-training, then fine-tuning." this one video is the clearest path from "I use ChatGPT" to "I understand how it's built." Watch it today ↓


Ex-Google AI Agent Architect just launched a full course on " Harness, Loop, AI Agent Memory system" 90% AI agents are wasting 60%+ of their tokens wrong 00:00 - Ai Agent Memory 12:06 - Harness, Loop 31:18 - Ai Agent System This 50-minute will replace 10 paid courses and guides on Harness and Looping Watch it today, then read how to build proper agent loops in the article below






