Get started
LLM Index

Alpaca vs. GPTNeo

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Alpaca GPTNeo
Developer Stanford EleutherAI, Together
Current generation – –
Initial release 2023-03-13 2021-03-21
Instruct tuned Yes No
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Noncommercial Apache 2.0
Model sizes 7B 1.3B, 2.7B
Links

Alpaca

Alpaca is an instruction-finetuned LLM based off of LLaMA.

The first of many instruct-finetuned versions of LLaMA, Alpaca is an instruction-following model introduced by Stanford researchers. Impressively, with only $600 of compute spend, the researchers demonstrated that on qualitative benchmarks Alpaca performed similarly to OpenAI's text-davinci-003, a significantly larger model.

GPTNeo

GPTNeo is a model released by EleutherAI to try and provide an open source model with capabilities similar to OpenAI's GPT-3 model. One of the earliest such models, GPTNeo was trained on The Pile, Eleuther's corpus of web text.

Compare other models

Other Alpaca comparisons

Other GPTNeo comparisons