LLM: Orca

Developer

Microsoft

Genealogy

LLaMA → Orca

Initial Release

2023-06-05

Overview

Orca is a descendant of LLaMA developed by Microsoft with finetuning on explanation traces obtained from GPT-4.

Description

Orca-13B is a LLM developed by Microsoft. It is based on LLaMA with finetuning on complex explanation traces obtained from GPT-4. By using rich signals, Orca surpasses the performance of models such as Vicuna-13B on complex tasks. However, given its model backbone and the data used for its finetuning, Orca is under noncommercial use.

Open Source

Yes

Instruct Tuned

Yes

Model Sizes

13B

Finetuning

Yes

License

Noncommercial

Pricing

-

Link

Visit

Further Reading

• https://arxiv.org/pdf/2306.02707.pdf

Unsure? Contact us with a brief description of your use case if you'd like for us to make a snap assessment. Depending on your requirements, a smaller, custom language model may even be the best option.