Kimi vs. MPT

Overview

Kimi is Moonshot AI's open-weight family for long-context reasoning, coding, multimodal agents, and research. Kimi K3 is the current generation.

Moonshot AI launched Kimi in 2023 with an early focus on long-context document understanding. Kimi K3, released in July 2026, is a 2.8T-parameter mixture-of-experts model with 104B active parameters. It combines native vision, a one-million-token context window, long-horizon coding, knowledge work, reasoning, and agent orchestration. The full model weights are available under the Kimi K3 License.

Initial release: 2023-10-09

Current generation: Kimi K3

Reference

https://huggingface.co/moonshotai/Kimi-K3

Further Reading

• https://github.com/MoonshotAI/Kimi-K2
• https://github.com/MoonshotAI/Kimi-K3
• https://huggingface.co/moonshotai/Kimi-K3

Overview

MPT-7B and MPT-30B are a set of models that are part of MosaicML's Foundation Series. Trained on 1T tokens, the developers state that MPT-7B matches the performance of LLaMA while also being open source, while MPT-30B outperforms the original GPT-3. In addition to the base model, the developers also offer MPT-Instruct, MPT-Chat, and MPT-7B-StoryWriter-65k+, the last of which is trained on a context length of 65K tokens.

Initial release: 2023-05-05

Reference

https://www.mosaicml.com/blog/mpt-30b

Further Reading

• https://www.mosaicml.com/blog/mpt-7b
• https://huggingface.co/mosaicml