Sapling Logo

GPT-J vs. LLaMA

LLM Comparison

GPT-J

Overview

GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.

Initial release: 2021-06-09

Reference

https://huggingface.co/EleutherAI/gpt-j-6b

Further Reading

LLaMA

Overview

The model that launched a frenzy in open-source instruct-finetuned models, LLaMA is Meta AI's more parameter-efficient, open-source alternative to large commercial LLMs. Despite being smaller than many commercial models, LLaMA outperformed the gold standard GPT-3 on many benchmarks, with the primary drawback being that its access remains gated to researchers with restrictions on commercial use.

Initial release: 2023-02-24

Reference

https://ai.facebook.com/blog/large-language-model-llama-meta-ai/

Further Reading

Looking for an LLM API/SDK that works out of the box?

Sapling API
More Comparisons

GPT-J

LLaMA
Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 Noncommercial
Model Sizes 6B 7B, 13B, 33B, 65B

Other GPT-J Comparisons

GPT-J vs. Alpaca GPT-J vs. BLOOM GPT-J vs. Cerebras-GPT GPT-J vs. Dolly GPT-J vs. FLAN-T5 GPT-J vs. FLAN-UL2 GPT-J vs. GPT4All GPT-J vs. GPTNeo GPT-J vs. Koala GPT-J vs. LLaMA GPT-J vs. MPT-7B GPT-J vs. OpenAssistant GPT-J vs. OpenLLaMA GPT-J vs. OPT GPT-J vs. Pythia GPT-J vs. RedPajama-INCITE GPT-J vs. StableLM GPT-J vs. StableVicuna GPT-J vs. Vicuna

Other LLaMA Comparisons

LLaMA vs. Alpaca LLaMA vs. BLOOM LLaMA vs. Cerebras-GPT LLaMA vs. Dolly LLaMA vs. FLAN-T5 LLaMA vs. FLAN-UL2 LLaMA vs. GPT-J LLaMA vs. GPT4All LLaMA vs. GPTNeo LLaMA vs. Koala LLaMA vs. MPT-7B LLaMA vs. OpenAssistant LLaMA vs. OpenLLaMA LLaMA vs. OPT LLaMA vs. Pythia LLaMA vs. RedPajama-INCITE LLaMA vs. StableLM LLaMA vs. StableVicuna LLaMA vs. Vicuna

Undecided?

Get Advice