Sapling Logo

GPT-J vs. Llama 2

LLM Comparison


GPT-J

GPT-J

Overview

GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.



Initial release: 2021-06-09

Further Reading

Llama 2

Llama 2

Overview

Llama 2 is Meta AI's open source LLM available both research and commercial use case.


The successor to LLaMA (henceforce "Llama 1"), Llama 2 was trained on 40% more data, has double the context length, and was tuned on a large dataset of human preferences (over 1 million such annotations) to ensure helpfulness and safety. It outperforms other open source models on both natural language understanding datasets as well as in head-to-head face-offs.


Initial release: 2023-07-18

Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.

Sapling API
More Comparisons

GPT-J

Llama 2
Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 Custom (Commercial OK)
Model Sizes 6B 7B, 13B, 70B

Other GPT-J Comparisons

GPT-J vs. Alpaca GPT-J vs. BLOOM GPT-J vs. BLOOMChat GPT-J vs. Cerebras-GPT GPT-J vs. Dolly GPT-J vs. Falcon GPT-J vs. FastChat GPT-J vs. FLAN-T5 GPT-J vs. FLAN-UL2 GPT-J vs. GPT4All GPT-J vs. GPTNeo GPT-J vs. Guanaco GPT-J vs. Koala GPT-J vs. LLaMA GPT-J vs. Llama 2 GPT-J vs. MPT GPT-J vs. OpenAssistant GPT-J vs. OpenLLaMA GPT-J vs. OPT GPT-J vs. Orca GPT-J vs. Pythia GPT-J vs. RedPajama-INCITE GPT-J vs. StableLM GPT-J vs. StableVicuna GPT-J vs. Vicuna GPT-J vs. WizardLM

Other Llama 2 Comparisons

Llama 2 vs. Alpaca Llama 2 vs. BLOOM Llama 2 vs. BLOOMChat Llama 2 vs. Cerebras-GPT Llama 2 vs. Dolly Llama 2 vs. Falcon Llama 2 vs. FastChat Llama 2 vs. FLAN-T5 Llama 2 vs. FLAN-UL2 Llama 2 vs. GPT-J Llama 2 vs. GPT4All Llama 2 vs. GPTNeo Llama 2 vs. Guanaco Llama 2 vs. Koala Llama 2 vs. LLaMA Llama 2 vs. MPT Llama 2 vs. OpenAssistant Llama 2 vs. OpenLLaMA Llama 2 vs. OPT Llama 2 vs. Orca Llama 2 vs. Pythia Llama 2 vs. RedPajama-INCITE Llama 2 vs. StableLM Llama 2 vs. StableVicuna Llama 2 vs. Vicuna Llama 2 vs. WizardLM

Undecided?

Get Advice