From GPT-2 to Kimi K3: Seven Years of 22,600x Scaling, the Main Line of Large Model Architecture is Building a 'Memory Operating System'
The article traces the evolution of large language models from GPT-2 to Kimi K3, highlighting a 22,600-fold increase in scale over seven years. It argues that the architectural trend is toward establishing a 'memory operating system' for AI.
OpenAI
Moonshot AI

