Describing itself as an ecosystem for open-source chatbots, Nomic provides a framework for training LLMs with LLaMA and GPT-J backbones.
Initial release: 2023-03-26
Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.
Initial release: 2022-05-03
|Products & Features|
|Model Sizes||7B, 13B||1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B|