Get started
LLM Index

GPTNeo vs. OPT

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute GPTNeo OPT
Developer EleutherAI, Together Meta
Current generation – –
Initial release 2021-03-21 2022-05-03
Instruct tuned No No
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 NA
Model sizes 1.3B, 2.7B 1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B
Links

GPTNeo

GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.

OPT

Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.

Compare other models

Other GPTNeo comparisons

Other OPT comparisons