Cerebras-GPT
The Cerebras-GPT family of models was developed by the AI accelerator company Cerebras following Chinchilla scaling laws as a demonstration of its Wafter-Scale Cluster technology.
A side-by-side comparison of release history, capabilities, licensing and model sizes.
| Attribute |
|
|
|---|---|---|
| Developer | Cerebras | LAION |
| Current generation | – | – |
| Initial release | 2023-03-28 | 2023-04-15 |
| Instruct tuned | No | Yes |
| Coding | No | No |
| Finetuning | Yes | Yes |
| Open source | Yes | Yes |
| License | Apache 2.0 | Varies |
| Model sizes | 1.3B, 2.7B, 6.7B, 13B | 6.7B, 6.9B, 7B, 12B, 30B |
| Links |
The Cerebras-GPT family of models was developed by the AI accelerator company Cerebras following Chinchilla scaling laws as a demonstration of its Wafter-Scale Cluster technology.
OpenAssistant is a project organized by LAION with aim of providing an open source alternative to ChatGPT. Its primary effort is to collected instruct examples to then tune existing LLMs. The first major release is available as part of Hugging Face's HuggingChat.