Simon Willison (@simonwillison.net): My notes on Kimi K3, plus some thoughts on what we can still learn from the pelican benchmark even while it becomes further detached from how good the models are at the things that matter (like agenti
A deep dive into a major new model's architecture, benchmarks, and real-world API performance, relevant for developers integrating cutting-edge AI.
AI Summary
Moonshot AI has released Kimi K3, a massive new language model with 2.8 trillion parameters, positioned as an open 3T-class model. The article analyzes its reported performance against top models like Claude and GPT-5.x, its new pricing structure, and uses a custom 'pelican ' (generating an SVG of a pelican riding a bicycle) to probe its reasoning and cost efficiency. It also discusses what such quirky, targeted benchmarks can reveal about a model's capabilities even as standard benchmarks become less indicative of real-world performance.
Excerpt
My notes on Kimi K3, plus some thoughts on what we can still learn from the pelican benchmark even while it becomes further detached from how good the models are at the things that matter (like agentic tool calling across longer conversations) simonwillison.net/2026/Jul/16/...
