serial

I've decided. I'm going to learn language models in two weeks. I'm not going to vibe code anything. I am going to implement a small gpt style transformer from scratch, train it on some datasets until it generates decent text. witness me

I've decided. I'm going to learn language models in two weeks. I'm not going to vibe code anything. I am going to implement a small gpt style transformer from scratch, train it on some datasets until it generates decent text. witness me

byte pair encoding is not complex at all

you won't believe my first stop

Am I crazy? Or is this all easy? Is the way that other people do this fundamentally wrong? Why does it take people so long to do things? I know people who are good at PCB development, people who are good at CAD. I know people who can make incredible winding machines, abuse mechanical principles to get ridiculous tolerances with very cheap hardware. They can 3d print all of it, build it, wire it up, and program it in a day. I know people who can produce a PCB in two hours, get it routed in another two. By the time the PCB gets to them, the firmware is already developed. Is it hard? Are you really struggling to do this? Why are you so slow? Why am I so slow? Why should I be slow? I shouldn't be slow. I'm not slow. I'll be fast. I know how easy it is for software. I can produce a viable software business out of thin air. I can produce good software, that has real world results in very short time. I can build the infrastructure to produce models to do things. Non trivial things. One thing I picked up from another startup founder here in Ottawa - "I only hire people that bring up the median of the company. They have to be better than me". He's pretty good. And yet, he can still find people. He has still hired people. You want to hire people that are so good, they create more work, more opportunities. People that are so good, their time gets filled up. Dangerous people. They don't fit into boxes. I don't want people that want to be in a box. I want people that hate boxes. I need things outside the box. If I wanted to be in a box, I'd have shipped my ass to california and worked for an AI lab, in a box, with other box dwellers. I need the opposite of this. Box escapers. Why? Why? Tell me why it isn't possible. Tell me why I can' design, produce, and get a PCB in 24 hours? Why not? Tell me why I can't produce a new prototype in a week, in a day, in an hour? Why you bastard, why? Why do we subject ourselves to such slow speeds. Why is everything so slow. We're moving fast. The team is moving fast. RND is moving fast. I'm pretty sure no one is even close to where we are on capability. We are ahead of most on product. And we haven't even raised money. But it's not fast enough. We're still waiting two fucking weeks for a loop. 1 week to get some CAD done. It's taking me personally a week to write new radio firmware. Why is it so slow. I need it to be faster. I need to see the result. I need to see it in real life. Bullshit hardware failures. Weird voltage spikes on development hardware. Why is this something that I am dealing with? Why isn't this a solved problem? Why is my cycle time, in the real world, so god damned slow. I need it to be faster. I need more speed. Most people would be okay, even satisfied with the speed that my team has been pushing. But I'm not. It's slow. It's slow for me. Why is it so god damned slow. Why am I so god damned slow. Why am I so slow at unbolting things, why am I so slow at CAD. I am so slow at routing. Why am I not fast like my friend from my manic Colorado engineer, why can't I make PCBs like my quirked up atlanta zoomer. My bar is high and I am personally not meeting it. It's not enough to just win. I need to be the best. I need to put so much distance to would-be competition that I'm not even making the same product. I need the speed to be unreasonable. I want people's eyes to pop out of their skulls when they realize how fast we have been going. If you are not fast I don't want you. I don't want bug men that take pictures of themselves sleeping under their desk on a timer. I want demons man. I want people that are hustling from desk to desk, station to station. I want movement, I want ego, I want geniuses. Creatives, engineers, builders. People who don't do it for status among those who don't matter, but those who do it for status with those who do matter They are out there. I met a 9th grader that was building bluetooth signal jammers for his highschool's hallways. I'm meeting two university students building radars they've designed themselves, one of them builds model rockets. I've met a guy putting neural networks into FPGAs. I know of an older fella, that builds model planes with gas engines. I know people doing totally not illegal things with meshcore on 915mhz. You can just connect to the network. You can just talk to them. They're there. The talent is there. Not in California. The ones still here man, they're still here. I need to make this work. I need to make a home for these people. I need to grow the business. I need to avoid raising investor money, creating bad incentives that will kill what I want. I reject it all. I reject the idea that going slower is reasonable. I reject the idea of being reasonable itself. I need urgency. I've seen it done. I've seen what happens when you reject being reasonable. I saw an engineer decide, that all the software engineers telling him Things were wrong, I saw him trust his gut. And he was right! Things moved fast. Things moved faster. And it all turned out fine. I'm not going for something that is simply sellable. I am going for something that will change the way you defend. I am going for the thing that will make everything that is sellable, moot. I am going for the problem, not the solution. I actually think we can do it. The crazy part is that it isn't even the hard part. The hard part is the factory, the scaling to meet demand. Giving the customer enough is the hard part. Making it high quality is the hard part. I need a team of the best engineers. People that are a legitimate danger. I need to actually develop this. I need to develop the space, the opportunity, I need to show people what is possible when you actually just try. Nothing pains me more than seeing smart people rot away to inaction. I want to let people know they can do things. I want them to know they can push. I want them to know that limits are self imposed. I just need to be patient. It will take time to build a team But not with my own speed. I personally need to move faster. I need more results. The results so far are not enough. I need more results