Moonshot AI released Kimi K3.1 Pro. It is an open-weight multimodal model with 2.8 trillion parameters. The model uses a mixture-of-experts design with 104 billion active parameters. It supports a 1 million token context window. It handles both text and image inputs. Moonshot AI reports gains in coding, agent tasks, reasoning and cybersecurity benchmarks. The model is available on Hugging Face. It is the first in the K3.1 series. It replaces some attention layers with gated sparse attention for long-context efficiency.
What it unlocks
Running a single model with text and image inputs across a million tokens of context.
- 2.8T total parameters
- 104B activated parameters
- 1M token context window
- 93 layers
What you need to act on it
- self-hosting or API access
Sources