Sapling Logo

GPT-J vs. Llama 3.1

LLM Comparison


GPT-J

GPT-J

Overview

GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.



Initial release: 2021-06-09

Further Reading

Llama 3.1

Llama 3.1

Overview

Llama 3.1 added a 405B flagship model that was the first open-source model competitive with frontier proprietary models, alongside updated 8B and 70B variants with longer context and improved tool use.


Llama 3.1 was a landmark release for open-source AI. The 405B model achieved parity with GPT-4o and Claude 3.5 Sonnet on many benchmarks, marking the first time an open model reached the proprietary frontier. All models support a 128K token context window, multilingual generation in eight languages, and built-in tool-calling capabilities. The permissive license allows commercial use for most organisations, making Llama 3.1 a popular foundation for fine-tuning and self-hosted deployments.


Initial release: 2024-07-23

Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.

Sapling API
More Comparisons

GPT-J

Llama 3.1

Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 Custom (Commercial OK)
Model Sizes 6B 8B, 70B, 405B