Sapling Logo

GPT-J vs. LLaMA

LLM Comparison

GPT-J

Overview

GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.

Initial release: 2021-06-09

Further Reading

LLaMA

Overview

The model that launched a frenzy in open-source instruct-finetuned models, LLaMA is Meta AI's more parameter-efficient, open-source alternative to large commercial LLMs. Despite being smaller than many commercial models, LLaMA outperformed the gold standard GPT-3 on many benchmarks, with the primary drawback being that its access remains gated to researchers with restrictions on commercial use.

Initial release: 2023-02-24

Looking for an LLM API/SDK that works out of the box?

Sapling API
More Comparisons

GPT-J

LLaMA

Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 Noncommercial
Model Sizes 6B 7B, 13B, 33B, 65B