BLOOM vs. Guanaco
LLM Comparison
BLOOM
Overview
BLOOM is a open source LLM developed as part of the BigScience Workshop by Hugging Face in collaboration with other research organizations.
A model proposed during the BigScience Workshop as an open-source alternative to GPT-3, BLOOM has since been superseded by recent models based on Meta's LLaMA model.
Initial release: 2022-07-06
Further Reading
Guanaco
Overview
Guanaco is an LLM based off the QLoRA 4-bit finetuning method developed by Tim Dettmers et. al. in the UW NLP group. Guanaco achieves 99% ChatGPT performance on the Vicuna benchmark.
Guanaco is an LLM that uses a finetuning method called LoRA that was developed by Tim Dettmers et. al. in the UW NLP group. With QLoRA, it becomes possible to finetune up to a 65B parameter model on a 48GB GPU without loss of performance relative to a 16-bit model. The Guanaco model family outperforms all previously released models on the Vicuna benchmark. However, given the models are based off of the LLaMA model family, commercial use is not permitted.
Initial release: 2023-05-23
Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.
Sapling APIMore Comparisons
BLOOM |
Guanaco |
|
|---|---|---|
| Products & Features | ||
| Instruct Models | ||
| Coding Capability | ||
| Customization | ||
| Finetuning | ||
| Open Source | ||
| License | Open RAIL-M v1 | Noncommercial |
| Model Sizes | 1.1B, 1.7B, 3B, 7.1B, 176B | 7B, 13B, 33B, 65B |