A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
 RedPajama-INCITE
|
 StableLM
|
|---|---|---|
| Developer | Together | Stability AI |
| Current generation | – | – |
| Initial release | 2023-05-05 | 2023-04-19 |
| Instruct tuned | Yes | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | CC BY-SA 4.0 |
| Model sizes | 3B, 7B | 3B, 7B |
| Links |
RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.
The StableLM series of language models is Stability AI's entry into the LLM space. Trained on The Pile, the initial release included 3B and 7B parameter models with larger models on the way.
