Get started
LLM Index

Orca

Orca is a descendant of LLaMA developed by Microsoft with finetuning on explanation traces obtained from GPT-4.

Microsoft · Open · Released 2023-06-05

This is an archived entry. It is no longer listed in the LLM Index.

Overview

Orca-13B is a LLM developed by Microsoft. It is based on LLaMA with finetuning on complex explanation traces obtained from GPT-4. By using rich signals, Orca surpasses the performance of models such as Vicuna-13B on complex tasks. However, given its model backbone and the data used for its finetuning, Orca is under noncommercial use.

Genealogy

Llama → Orca

Further reading