A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 Pythia
|
 StableLM
|
|---|---|---|
| Developer | EleutherAI, Together | Stability AI |
| Current generation | – | – |
| Initial release | 2023-02-13 | 2023-04-19 |
| Instruct tuned | No | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | CC BY-SA 4.0 |
| Model sizes | 1B, 1.4B, 2.8B, 6.9B, 12B | 3B, 7B |
| Links |
The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.
The StableLM series of language models is Stability AI's entry into the LLM space. Trained on The Pile, the initial release included 3B and 7B parameter models with larger models on the way.
