Llama 2 is Meta AI's open source LLM available both research and commercial use case.
The successor to LLaMA (henceforce "Llama 1"), Llama 2 was trained on 40% more data, has double the context length, and was tuned on a large dataset of human preferences (over 1 million such annotations) to ensure helpfulness and safety. It outperforms other open source models on both natural language understanding datasets as well as in head-to-head face-offs.
Initial release: 2023-07-18
Orca is a descendant of LLaMA developed by Microsoft with finetuning on explanation traces obtained from GPT-4.
Orca-13B is a LLM developed by Microsoft. It is based on LLaMA with finetuning on complex explanation traces obtained from GPT-4. By using rich signals, Orca surpasses the performance of models such as Vicuna-13B on complex tasks. However, given its model backbone and the data used for its finetuning, Orca is under noncommercial use.
Initial release: 2023-06-05
|Products & Features|
|License||Custom (Commercial OK)||Noncommercial|
|Model Sizes||7B, 13B, 70B||13B|