A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 GPT-J
|
 OpenLLaMA
|
|---|---|---|
| Developer | EleutherAI | OpenLM Research |
| Current generation | – | – |
| Initial release | 2021-06-09 | 2023-04-28 |
| Instruct tuned | Yes | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | Apache 2.0 |
| Model sizes | 6B | 3B, 7B, 13B |
| Links |
GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.
OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.
