Sapling Logo

LLaMA vs. OPT

LLM Comparison

LLaMA

Overview

The model that launched a frenzy in open-source instruct-finetuned models, LLaMA is Meta AI's more parameter-efficient, open-source alternative to large commercial LLMs. Despite being smaller than many commercial models, LLaMA outperformed the gold standard GPT-3 on many benchmarks, with the primary drawback being that its access remains gated to researchers with restrictions on commercial use.

Initial release: 2023-02-24

Reference

https://ai.facebook.com/blog/large-language-model-llama-meta-ai/

Further Reading

OPT

Overview

Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.

Initial release: 2022-05-03

Reference

https://github.com/facebookresearch/metaseq/tree/main/projects/OPT

Further Reading

Looking for an LLM API/SDK that works out of the box?

Sapling API
More Comparisons

LLaMA

OPT
Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Noncommercial NA
Model Sizes 7B, 13B, 33B, 65B 1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B

Other LLaMA Comparisons

LLaMA vs. Alpaca LLaMA vs. BLOOM LLaMA vs. Cerebras-GPT LLaMA vs. Dolly LLaMA vs. FLAN-T5 LLaMA vs. FLAN-UL2 LLaMA vs. GPT-J LLaMA vs. GPT4All LLaMA vs. GPTNeo LLaMA vs. Koala LLaMA vs. MPT-7B LLaMA vs. OpenAssistant LLaMA vs. OpenLLaMA LLaMA vs. OPT LLaMA vs. Pythia LLaMA vs. RedPajama-INCITE LLaMA vs. StableLM LLaMA vs. StableVicuna LLaMA vs. Vicuna

Other OPT Comparisons

OPT vs. Alpaca OPT vs. BLOOM OPT vs. Cerebras-GPT OPT vs. Dolly OPT vs. FLAN-T5 OPT vs. FLAN-UL2 OPT vs. GPT-J OPT vs. GPT4All OPT vs. GPTNeo OPT vs. Koala OPT vs. LLaMA OPT vs. MPT-7B OPT vs. OpenAssistant OPT vs. OpenLLaMA OPT vs. Pythia OPT vs. RedPajama-INCITE OPT vs. StableLM OPT vs. StableVicuna OPT vs. Vicuna

Undecided?

Get Advice