The Cerebras-GPT family of models was developed by the AI accelerator company Cerebras following Chinchilla scaling laws as a demonstration of its Wafter-Scale Cluster technology.
Initial release: 2023-03-28
Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.
Initial release: 2022-05-03
|Products & Features|
|Model Sizes||1.3B, 2.7B, 6.7B, 13B||1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B|