Get started
LLM Index

Falcon vs. WizardLM

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Falcon WizardLM
Developer TII WizardLM
Current generation – –
Initial release 2023-05-23 2023-05-26
Instruct tuned Yes Yes
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 Noncommercial
Model sizes 7B, 40B 7B, 13B, 70B, 8x22B
Links
Website
Website

Falcon

Falcon LLM is the flagship LLM of the Technology Innovation Institute in Abu Dhabi.

Falcon LLM is a powerful LLM developed by the Technology Innovation Institute (https://www.tii.ae). Unlike other popular LLMs, Falcon was not built off of LLaMA, but instead using a custom data pipeline and distributed training system. The dataset is the RefinedWeb dataset (available on Hugging Face), and the initial models are available in 7B and 40B forms. Instruct and chat-finetuned models are available as well. Perhaps most excitingly, Falcon outperforms LLaMA, the previous de facto pretrained LLM.

Further reading

WizardLM

WizardLM is a variant of LLaMA trained with complex instructions.

WizardLM is a LLM based on LLaMA trained using a new method, called Evol-Instruct, on complex instruction data. By using AI to "evolve" instructions, WizardLM outperforms similar LLaMA-based LLMs trained on simpler instruction data. On the 6th of July, 2023, WizardLM V1.1 was released with significantly improved performance, and as of 15 April 2024, WizardLM-2 was released with state-of-the-art performance.

Further reading

Compare other models

Other Falcon comparisons

Other WizardLM comparisons