Get started
LLM Index

Alpaca vs. Pythia

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Alpaca Pythia
Developer Stanford EleutherAI, Together
Current generation – –
Initial release 2023-03-13 2023-02-13
Instruct tuned Yes No
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Noncommercial Apache 2.0
Model sizes 7B 1B, 1.4B, 2.8B, 6.9B, 12B
Links

Alpaca

Alpaca is an instruction-finetuned LLM based off of LLaMA.

The first of many instruct-finetuned versions of LLaMA, Alpaca is an instruction-following model introduced by Stanford researchers. Impressively, with only $600 of compute spend, the researchers demonstrated that on qualitative benchmarks Alpaca performed similarly to OpenAI's text-davinci-003, a significantly larger model.

Pythia

The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.

Compare other models

Other Alpaca comparisons

Other Pythia comparisons