GPTNeo
GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.
A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 GPTNeo
|
 OpenLLaMA
|
|---|---|---|
| Developer | EleutherAI, Together | OpenLM Research |
| Current generation | – | – |
| Initial release | 2021-03-21 | 2023-04-28 |
| Instruct tuned | No | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | Apache 2.0 |
| Model sizes | 1.3B, 2.7B | 3B, 7B, 13B |
| Links |
GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.
OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.