Kimi K3 on PAC1 and ECOM1: results of 204 tasks and failure analysis
Moonshot AI open-sourced Kimi K3 in July. The model was tested on two BitGN benchmarks (PAC1 and ECOM1) with 204 open traces. Results show strong performance on simple retrieval and calculations but frequent failures on multi-file atomic operations, untrusted input checking, and long-table consistency.
Moonshot AI



