A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 OpenLLaMA
|
 Pythia
|
|---|---|---|
| Developer | OpenLM Research | EleutherAI, Together |
| Current generation | – | – |
| Initial release | 2023-04-28 | 2023-02-13 |
| Instruct tuned | No | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | Apache 2.0 |
| Model sizes | 3B, 7B, 13B | 1B, 1.4B, 2.8B, 6.9B, 12B |
| Links |
OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.
The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.
