OpenMythos

OpenMythos is an open-source, theoretical reconstruction of the Claude Mythos model. It implements a Recurrent-Depth Transformer (RDT) featuring three stages: Prelude, a looped Recurrent Block, and a Coda. By recycling layer weights multiple times within a single forward pass, it enables deep, continuous latent-space reasoning equivalent to implicit Chain-of-Thought without expanding parameter size. Supporting switchable MLA/GQA attention and sparse MoE, it guarantees training stability via dynamical systems constraints.

• Recurrent-Depth Transformer (RDT) Architecture
• Switchable MLA and GQA Attention
• Implicit CoT in Continuous Latent Space
• Dynamical Systems Constraint for Loop Stability
• Sparse MoE with Routed and Shared Experts