Sapling Logo

Gemma 2 vs. Guanaco

LLM Comparison


Gemma 2

Gemma 2

Overview

Gemma 2 succeeds the Gemma family of lightweight open models from Google built using the same processes used for the the larger Gemini models.


Gemma 2 is the successor to the Gemma family of open models, including larer models (9B and 27B parameters) with outsized performance across benchmarks. Using a combination of techniques such as training on twice as much data, knowledge distillation, and architectural improvements such as sliding window attention, logit soft-capping, and model merging, Gemma 2 outperforms models of similar size (such as Llama 3), with the 27B parameter model being competitive with models more than twice its size (such as Llama 70B).


Initial release: 2024-06-27

Guanaco

Guanaco

Overview

Guanaco is an LLM based off the QLoRA 4-bit finetuning method developed by Tim Dettmers et. al. in the UW NLP group. Guanaco achieves 99% ChatGPT performance on the Vicuna benchmark.


Guanaco is an LLM that uses a finetuning method called LoRA that was developed by Tim Dettmers et. al. in the UW NLP group. With QLoRA, it becomes possible to finetune up to a 65B parameter model on a 48GB GPU without loss of performance relative to a 16-bit model. The Guanaco model family outperforms all previously released models on the Vicuna benchmark. However, given the models are based off of the LLaMA model family, commercial use is not permitted.


Initial release: 2023-05-23

Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.

Sapling API
More Comparisons

Gemma 2

Guanaco
Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Custom Noncommercial
Model Sizes 2.6B, 9B, 27B 7B, 13B, 33B, 65B

Other Gemma 2 Comparisons

Gemma 2 vs. Alpaca Gemma 2 vs. Cerebras-GPT Gemma 2 vs. Dolly Gemma 2 vs. Falcon Gemma 2 vs. FastChat Gemma 2 vs. FLAN-T5 Gemma 2 vs. FLAN-UL2 Gemma 2 vs. Gemma Gemma 2 vs. GPT-J Gemma 2 vs. GPT4All Gemma 2 vs. GPTNeo Gemma 2 vs. Grok Gemma 2 vs. Guanaco Gemma 2 vs. Koala Gemma 2 vs. LLaMA Gemma 2 vs. Llama 2 Gemma 2 vs. Llama 3 Gemma 2 vs. Mistral Gemma 2 vs. MPT Gemma 2 vs. OpenAssistant Gemma 2 vs. OpenLLaMA Gemma 2 vs. OPT Gemma 2 vs. Orca Gemma 2 vs. Phi Gemma 2 vs. Pythia Gemma 2 vs. RedPajama-INCITE Gemma 2 vs. StableLM Gemma 2 vs. StableVicuna Gemma 2 vs. Vicuna Gemma 2 vs. WizardLM

Other Guanaco Comparisons

Guanaco vs. Alpaca Guanaco vs. Cerebras-GPT Guanaco vs. Dolly Guanaco vs. Falcon Guanaco vs. FastChat Guanaco vs. FLAN-T5 Guanaco vs. FLAN-UL2 Guanaco vs. Gemma Guanaco vs. Gemma 2 Guanaco vs. GPT-J Guanaco vs. GPT4All Guanaco vs. GPTNeo Guanaco vs. Grok Guanaco vs. Koala Guanaco vs. LLaMA Guanaco vs. Llama 2 Guanaco vs. Llama 3 Guanaco vs. Mistral Guanaco vs. MPT Guanaco vs. OpenAssistant Guanaco vs. OpenLLaMA Guanaco vs. OPT Guanaco vs. Orca Guanaco vs. Phi Guanaco vs. Pythia Guanaco vs. RedPajama-INCITE Guanaco vs. StableLM Guanaco vs. StableVicuna Guanaco vs. Vicuna Guanaco vs. WizardLM

Undecided?

Get Advice