Llama 2 is Meta AI's open source LLM available both research and commercial use case.
The successor to LLaMA (henceforce "Llama 1"), Llama 2 was trained on 40% more data, has double the context length, and was tuned on a large dataset of human preferences (over 1 million such annotations) to ensure helpfulness and safety. It outperforms other open source models on both natural language understanding datasets as well as in head-to-head face-offs.
Initial release: 2023-07-18
RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.
Initial release: 2023-05-05
|Products & Features|
|License||Custom (Commercial OK)||Apache 2.0|
|Model Sizes||7B, 13B, 70B||3B, 7B|