Get started
LLM Index

Guanaco vs. WizardLM

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Guanaco WizardLM
Developer UW NLP WizardLM
Current generation – –
Initial release 2023-05-23 2023-05-26
Instruct tuned Yes Yes
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Noncommercial Noncommercial
Model sizes 7B, 13B, 33B, 65B 7B, 13B, 70B, 8x22B
Links
Website
Website

Guanaco

Guanaco is an LLM based off the QLoRA 4-bit finetuning method developed by Tim Dettmers et. al. in the UW NLP group. Guanaco achieves 99% ChatGPT performance on the Vicuna benchmark.

Guanaco is an LLM that uses a finetuning method called LoRA that was developed by Tim Dettmers et. al. in the UW NLP group. With QLoRA, it becomes possible to finetune up to a 65B parameter model on a 48GB GPU without loss of performance relative to a 16-bit model. The Guanaco model family outperforms all previously released models on the Vicuna benchmark. However, given the models are based off of the LLaMA model family, commercial use is not permitted.

Further reading

WizardLM

WizardLM is a variant of LLaMA trained with complex instructions.

WizardLM is a LLM based on LLaMA trained using a new method, called Evol-Instruct, on complex instruction data. By using AI to "evolve" instructions, WizardLM outperforms similar LLaMA-based LLMs trained on simpler instruction data. On the 6th of July, 2023, WizardLM V1.1 was released with significantly improved performance, and as of 15 April 2024, WizardLM-2 was released with state-of-the-art performance.

Further reading

Compare other models

Other Guanaco comparisons

Other WizardLM comparisons