Get started
LLM Index

Falcon vs. Orca

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Falcon Orca
Developer TII Microsoft
Current generation – –
Initial release 2023-05-23 2023-06-05
Instruct tuned Yes Yes
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 Noncommercial
Model sizes 7B, 40B 13B
Links
Website
Website

Falcon

Falcon LLM is the flagship LLM of the Technology Innovation Institute in Abu Dhabi.

Falcon LLM is a powerful LLM developed by the Technology Innovation Institute (https://www.tii.ae). Unlike other popular LLMs, Falcon was not built off of LLaMA, but instead using a custom data pipeline and distributed training system. The dataset is the RefinedWeb dataset (available on Hugging Face), and the initial models are available in 7B and 40B forms. Instruct and chat-finetuned models are available as well. Perhaps most excitingly, Falcon outperforms LLaMA, the previous de facto pretrained LLM.

Further reading

Orca

Orca is a descendant of LLaMA developed by Microsoft with finetuning on explanation traces obtained from GPT-4.

Orca-13B is a LLM developed by Microsoft. It is based on LLaMA with finetuning on complex explanation traces obtained from GPT-4. By using rich signals, Orca surpasses the performance of models such as Vicuna-13B on complex tasks. However, given its model backbone and the data used for its finetuning, Orca is under noncommercial use.

Further reading

Compare other models

Other Falcon comparisons

Other Orca comparisons