GPTNeo
GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.
A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 GPTNeo
|
Kimi |
|---|---|---|
| Developer | EleutherAI, Together | Moonshot AI |
| Current generation | – | Kimi K3 |
| Initial release | 2021-03-21 | 2023-10-09 |
| Instruct tuned | No | Yes |
| Coding | No | Yes |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | Kimi K3 License |
| Model sizes | 1.3B, 2.7B | 2.8T (104B active) |
| Links |
GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.
Kimi is Moonshot AI's open-weight family for long-context reasoning, coding, multimodal agents, and research. Kimi K3 is the current generation.
Moonshot AI launched Kimi in 2023 with an early focus on long-context document understanding. Kimi K3, released in July 2026, is a 2.8T-parameter mixture-of-experts model with 104B active parameters. It combines native vision, a one-million-token context window, long-horizon coding, knowledge work, reasoning, and agent orchestration. The full model weights are available under the Kimi K3 License.