Sapling Logo

Guanaco vs. Llama 2

LLM Comparison


Guanaco

Guanaco

Overview

Guanaco is an LLM based off the QLoRA 4-bit finetuning method developed by Tim Dettmers et. al. in the UW NLP group. Guanaco achieves 99% ChatGPT performance on the Vicuna benchmark.


Guanaco is an LLM that uses a finetuning method called LoRA that was developed by Tim Dettmers et. al. in the UW NLP group. With QLoRA, it becomes possible to finetune up to a 65B parameter model on a 48GB GPU without loss of performance relative to a 16-bit model. The Guanaco model family outperforms all previously released models on the Vicuna benchmark. However, given the models are based off of the LLaMA model family, commercial use is not permitted.


Initial release: 2023-05-23

Llama 2

Llama 2

Overview

Llama 2 is Meta AI's open source LLM available for both research and commercial use cases (assuming you're not one of the top consumer companies in the world).


The successor to LLaMA (henceforce "Llama 1"), Llama 2 was trained on 40% more data, has double the context length, and was tuned on a large dataset of human preferences (over 1 million such annotations) to ensure helpfulness and safety. It outperforms other open source models on both natural language understanding datasets as well as in head-to-head face-offs.


Initial release: 2023-07-18

Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.

Sapling API
More Comparisons

Guanaco

Llama 2

Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Noncommercial Custom (Commercial OK)
Model Sizes 7B, 13B, 33B, 65B 7B, 13B, 70B