

Adam King
3.3K posts

@SystemsForScale
🚀 Founder of @telecmd & AXureousLLC 🤖 Creator of AXIS Automation 📈 Building systems that turn traffic into revenue




the uk has revoked my visa as well. all at the behest of israel. the west is betraying "liberal values" for a genocidal fascist foreign government. soon we will all become israel.





Training an LLM from scratch is easier to study when the whole path is in one repo. Train LLM From Scratch is a PyTorch repository for learning how a transformer language model is built, trained, saved, and used for text generation. It helps you move from “I understand attention on paper” to a runnable training pipeline by pairing model code with data download, preprocessing, config, training, and generation scripts. Key features: • Transformer components from scratch – separate PyTorch modules for MLP, attention, transformer blocks, and the final model • Pile-based data path – scripts download The Pile files and preprocess JSONL.ZST text into tokenized HDF5 datasets • Configurable training setup – model size, context length, heads, blocks, batch size, learning rate, and file paths live in config.py • Hardware guidance – README compares common GPUs for 13M and 2B-class training runs • Generation workflow included – generate_text.py loads trained checkpoints and produces sample text outputs It’s open-source (MIT license). Link in the reply 👇














Building AI-powered tools in public. 12+ years in Digital Marketing. Now applying AI to real systems. Here I share: • AI workflows / Tools • Vibe coding lessons • SaaS insights • Digital Marketing & SEO Follow to build and scale faster.



