Vis.eth
862 posts

Vis.eth
@vis_eth
Invest as a builder, see the world like a dreamer!











Introducing OpenMythos An open-source, first-principles theoretical reconstruction of Claude Mythos, implemented in PyTorch. The architecture instantiates a looped transformer with a Mixture-of-Experts (MoE) routing mechanism, enabling iterative depth via weight sharing and conditional computation across experts. My implementation explores the hypothesis that recursive application of a fixed parameterized block, coupled with sparse expert activation, can yield improved efficiency–performance tradeoffs and emergent multi-step reasoning. Learn more ⬇️🧵




It was a great time chatting with Vera @veratheape Figge @mfigge and Adam @AdamWeitsman , the Apes will be back at the club again.










