RoundTable21

Huge thanks to @StakingRewards for inviting RT21’s @Ithiel out to #Bangkok to talk about #Bittensor and our $TAO Bunker #Validator

On the @theallinpod this week, @chamath asked @nvidia CEO Jensen Huang about decentralized AI training, calling our Covenant-72B run "a pretty crazy technical accomplishment." One correction: it's 72 billion parameters, not four. Trained permissionlessly across 70+ contributors on commodity internet. The largest model ever pre-trained on fully decentralized infrastructure. Jensen's answer is worth hearing too.

@aakashgupta A quarter million is still a lot cheaper than $500mil - regardless of whether you're buying or renting it. Either way, it's a big step forward.

A quarter million dollars in GPUs is the entry ticket to “democratized” AI training. Each participant needed a minimum of 8x NVIDIA B200 GPUs. “Anyone with GPUs could join” is technically true the same way “anyone can buy a Gulfstream” is technically true. Twenty-plus contributors scattered across the globe just finished training a 72 billion parameter model on 1.1 trillion tokens, coordinated over commodity internet, with no central cluster and no whitelist. The engineering is legitimately impressive. They compressed gradient communication by 146x using SparseLoCo, let participants join and leave mid-run without killing the training process, and used a blockchain incentive layer (Bittensor subnet 3) to pay contributors in TAO tokens for staying honest and keeping machines running. Six months ago the largest permissionless decentralized run was INTELLECT-1 at 10B parameters. Covenant jumped to 72B. That’s a 7x parameter leap while removing the trust assumption entirely. Now the context that matters. GPT-4 trained on roughly 25,000 A100s in a dedicated cluster estimated at $500 million in infrastructure. OpenAI’s total compute bill hit $5 billion in 2024. The industry is racing toward $100 billion clusters by 2028. Covenant-72B benchmarks “competitively with centralized models at similar scale,” which means competitive with LLaMA-2-70B, a model Meta released in July 2023 using a conventional data center. The 72B number sounds massive until you remember frontier models are now in the trillions of parameters, trained on 10-15x more tokens, with post-training pipelines that cost as much as the pre-training itself. What Covenant proved: distributed training over the open internet works at a scale that would have been unthinkable two years ago. The optimizer is brilliant. The infrastructure leap is real. And “permissionless” still costs a quarter million dollars at the door.

1/ The Evolution of @21RoundTable→ General Tensor Validator Same operators. Now operating as part of General Tensor.

"This isn't a change in direction. It's the natural outcome of our growth." We rebranded RoundTable21 as General Tensor Validator (GTV), deepening our commitment to scaling, decentralization, and institutional-grade reliability within Bittensor. Same trusted operators. Same infrastructure. More conviction. Full coverage below↓

@xponentcrisis @generaltensor *Footage of CapriciousSage defending the bunker*

@21RoundTable @generaltensor Congrats! Now you can afford anti air defence missiles for your bunker

Excited to enter the next phase with our partners over at @generaltensor 🔥 Operationally, everything remains the same - same team (Capri, WildCommie and WildMax), same bunker, same commitment… now with a shiny new name on the door 😁

Blessed week to all my Crypto X Brothers. Thanks to my brothers at @21RoundTable for their solid and continuous support to the charity work, providing the means to keep Leukaemia patients continuing their treatment during hard times

Blessed weekend to all my Crypto X Brothers. Thanks to my brothers at @21RoundTable for their continuous support in one of our most difficult moments here, mostly for children fighting Leukemia, providing them the means for them to continue the fight

🧵1/8 Today, General TAO Ventures becomes General Tensor.

🚨 TGE season is here. Our token $DN goes live today at 10am UTC. Stay safe, beware of scammers. Information regarding the launch is only shared on this account and on our other official channels: 🔗 deepnode.ai 🔗 discord.com/invite/deepnode 🔗 coinmarketcap.com/currencies/dee…

@HungNgu76442123 @synapz_org @DrocksAlex2 @gtaoventures

@synapz_org @DrocksAlex2 @gtaoventures @21RoundTable Wait for the IPO upcoming for GTV

📢 New year. New identity. We're evolving into a name that better represents our vertical integration across #Bittensor and the vision we're bringing to life. More details very very soon.

@DrocksAlex2 @gtaoventures Secret Squirrel Business

@gtaoventures @21RoundTable Why did you tag Roundtable21

@gonzalo_fuente1 Welcome back mate

🎆Quick and happy update 💕 I sincerely thank Const for the unban. Thanks to everyone I've contacted for intercession and who has or was about to contact Const (so Vlad, CapriciousSage, TP, Punisher, Alex, and everyone else🫂). Thank you! 🫶 I love Tao. Sincerely.

👀 x.com/wildsagelabs/s…

Some very exciting $TAO news in the works from the teams at @gtaoventures and @wildsagelabs #WatchThisSpace #Bittensor

@fougars67 @wildsagelabs @wildcommie @hyper_tensor We believe that decentralized AI needs many projects driving innovation to succeed - and we’re going to try and run infra for those that make sense to us Current list is $TAO $TENSOR $DN (+others soon) Some are hugely successful. Others (*cough* $COMAI + $ARGO), not so much 😅

@21RoundTable @wildsagelabs @wildcommie @hyper_tensor Is running a validator not profitable anymore? Need more extra cash promoting this?😂

While waiting for new infra to arrive at the @wildsagelabs Validator #Bunker, we accidently left @wildcommie unattended, so he built a new @hyper_tensor block explorer! $TENSOR Last time he was left alone, a new 200m deep well unexpectly appeared, so I think this is progress 😂

@fougars67 @wildsagelabs For Decentralized AI to win, we need multiple projects in the space trying different things @OpenAI and @AnthropicAI aren’t where they are in spite of each other - but BECAUSE of each other The more players in the decentralized AI space, the more ideas, the more innovation

@21RoundTable @wildsagelabs Nah bros😂😭💀 cant be seriously shilling this BS😂

It's a $TENSOR Christmas in the @WildSageLabs Bunker. #Testnet