Sapling Logo

GPT-J vs. Llama 2

LLM Comparison


GPT-J

GPT-J

Overview

GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.



Initial release: 2021-06-09

Further Reading

Llama 2

Llama 2

Overview

Llama 2 is Meta AI's open source LLM available for both research and commercial use cases (assuming you're not one of the top consumer companies in the world).


The successor to LLaMA (henceforce "Llama 1"), Llama 2 was trained on 40% more data, has double the context length, and was tuned on a large dataset of human preferences (over 1 million such annotations) to ensure helpfulness and safety. It outperforms other open source models on both natural language understanding datasets as well as in head-to-head face-offs.


Initial release: 2023-07-18

Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.

Sapling API
More Comparisons

GPT-J

Llama 2
Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 Custom (Commercial OK)
Model Sizes 6B 7B, 13B, 70B

Other GPT-J Comparisons

GPT-J vs. Alpaca GPT-J vs. Cerebras-GPT GPT-J vs. Dolly GPT-J vs. Falcon GPT-J vs. FastChat GPT-J vs. FLAN-T5 GPT-J vs. FLAN-UL2 GPT-J vs. Gemma GPT-J vs. Gemma 2 GPT-J vs. GPT4All GPT-J vs. GPTNeo GPT-J vs. Grok GPT-J vs. Guanaco GPT-J vs. Koala GPT-J vs. LLaMA GPT-J vs. Llama 2 GPT-J vs. Llama 3 GPT-J vs. Mistral GPT-J vs. MPT GPT-J vs. OpenAssistant GPT-J vs. OpenLLaMA GPT-J vs. OPT GPT-J vs. Orca GPT-J vs. Phi GPT-J vs. Pythia GPT-J vs. RedPajama-INCITE GPT-J vs. StableLM GPT-J vs. StableVicuna GPT-J vs. Vicuna GPT-J vs. WizardLM

Other Llama 2 Comparisons

Llama 2 vs. Alpaca Llama 2 vs. Cerebras-GPT Llama 2 vs. Dolly Llama 2 vs. Falcon Llama 2 vs. FastChat Llama 2 vs. FLAN-T5 Llama 2 vs. FLAN-UL2 Llama 2 vs. Gemma Llama 2 vs. Gemma 2 Llama 2 vs. GPT-J Llama 2 vs. GPT4All Llama 2 vs. GPTNeo Llama 2 vs. Grok Llama 2 vs. Guanaco Llama 2 vs. Koala Llama 2 vs. LLaMA Llama 2 vs. Llama 3 Llama 2 vs. Mistral Llama 2 vs. MPT Llama 2 vs. OpenAssistant Llama 2 vs. OpenLLaMA Llama 2 vs. OPT Llama 2 vs. Orca Llama 2 vs. Phi Llama 2 vs. Pythia Llama 2 vs. RedPajama-INCITE Llama 2 vs. StableLM Llama 2 vs. StableVicuna Llama 2 vs. Vicuna Llama 2 vs. WizardLM

Undecided?

Get Advice