GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.
Initial release: 2021-06-09
LLaMA was previously Meta AI's most performant LLM available for researchers and noncommercial use cases. It has since been succeeded by Llama 2.
The model that launched a frenzy in open-source instruct-finetuned models, LLaMA is Meta AI's more parameter-efficient, open alternative to large commercial LLMs. Despite being smaller than many commercial models, LLaMA outperformed the gold standard GPT-3 on many benchmarks, with the primary drawback being that its access remains gated to researchers with restrictions on commercial use.
Initial release: 2023-02-24
|Products & Features|
|Model Sizes||6B||7B, 13B, 33B, 65B|