OPT
Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.
A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 OPT
|
 StableLM
|
|---|---|---|
| Developer | Meta | Stability AI |
| Current generation | – | – |
| Initial release | 2022-05-03 | 2023-04-19 |
| Instruct tuned | No | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | NA | CC BY-SA 4.0 |
| Model sizes | 1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B | 3B, 7B |
| Links |
Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.
The StableLM series of language models is Stability AI's entry into the LLM space. Trained on The Pile, the initial release included 3B and 7B parameter models with larger models on the way.