Cerebras-GPT
The Cerebras-GPT family of models was developed by the AI accelerator company Cerebras following Chinchilla scaling laws as a demonstration of its Wafter-Scale Cluster technology.
A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
|
|
|---|---|---|
| Developer | Cerebras | OpenLM Research |
| Current generation | – | – |
| Initial release | 2023-03-28 | 2023-04-28 |
| Instruct tuned | No | No |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | Apache 2.0 |
| Model sizes | 1.3B, 2.7B, 6.7B, 13B | 3B, 7B, 13B |
| Links |
The Cerebras-GPT family of models was developed by the AI accelerator company Cerebras following Chinchilla scaling laws as a demonstration of its Wafter-Scale Cluster technology.
OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.