GPTNeo
GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.
A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 GPTNeo
|
 StableLM
|
|---|---|---|
| Developer | EleutherAI, Together | Stability AI |
| Current generation | – | – |
| Initial release | 2021-03-21 | 2023-04-19 |
| Instruct tuned | No | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | CC BY-SA 4.0 |
| Model sizes | 1.3B, 2.7B | 3B, 7B |
| Links |
GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.
The StableLM series of language models is Stability AI's entry into the LLM space. Trained on The Pile, the initial release included 3B and 7B parameter models with larger models on the way.