Get started
LLM Index

GPT-J vs. Guanaco

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute GPT-J Guanaco
Developer EleutherAI UW NLP
Current generation – –
Initial release 2021-06-09 2023-05-23
Instruct tuned Yes Yes
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 Noncommercial
Model sizes 6B 7B, 13B, 33B, 65B
Links

GPT-J

GPT-J is a model released by EleutherAI shortly after its release of GPTNeo, with the aim of delveoping an open source model with capabilities similar to OpenAI's GPT-3 model. With a larger size than GPTNeo, GPT-J also performs better on various benchmarks.

Guanaco

Guanaco is an LLM based off the QLoRA 4-bit finetuning method developed by Tim Dettmers et. al. in the UW NLP group. Guanaco achieves 99% ChatGPT performance on the Vicuna benchmark.

Guanaco is an LLM that uses a finetuning method called LoRA that was developed by Tim Dettmers et. al. in the UW NLP group. With QLoRA, it becomes possible to finetune up to a 65B parameter model on a 48GB GPU without loss of performance relative to a 16-bit model. The Guanaco model family outperforms all previously released models on the Vicuna benchmark. However, given the models are based off of the LLaMA model family, commercial use is not permitted.

Further reading

Compare other models

Other GPT-J comparisons

Other Guanaco comparisons