Get started
LLM Index

Guanaco vs. OpenLLaMA

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Guanaco OpenLLaMA
Developer UW NLP OpenLM Research
Current generation – –
Initial release 2023-05-23 2023-04-28
Instruct tuned Yes No
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Noncommercial Apache 2.0
Model sizes 7B, 13B, 33B, 65B 3B, 7B, 13B
Links

Guanaco

Guanaco is an LLM based off the QLoRA 4-bit finetuning method developed by Tim Dettmers et. al. in the UW NLP group. Guanaco achieves 99% ChatGPT performance on the Vicuna benchmark.

Guanaco is an LLM that uses a finetuning method called LoRA that was developed by Tim Dettmers et. al. in the UW NLP group. With QLoRA, it becomes possible to finetune up to a 65B parameter model on a 48GB GPU without loss of performance relative to a 16-bit model. The Guanaco model family outperforms all previously released models on the Vicuna benchmark. However, given the models are based off of the LLaMA model family, commercial use is not permitted.

Further reading

OpenLLaMA

OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.

Further reading

Compare other models

Other Guanaco comparisons

Other OpenLLaMA comparisons