Dolly vs. LLaMA

Overview

Dolly is an LLM trained using the Databricks machine learning platform. Originally released without instruct-finetuning, Dolly v2 included tuning on the Stanford Alpaca dataset.

Initial release: 2023-03-24

Reference

https://www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm

Further Reading

Overview

LLaMA was previously Meta AI's most performant LLM available for researchers and noncommercial use cases. It has since been succeeded by Llama 2.

The model that launched a frenzy in open-source instruct-finetuned models, LLaMA is Meta AI's more parameter-efficient, open alternative to large commercial LLMs. Despite being smaller than many commercial models, LLaMA outperformed the gold standard GPT-3 on many benchmarks, with the primary drawback being that its access remains gated to researchers with restrictions on commercial use.

Initial release: 2023-02-24

Reference

https://ai.facebook.com/blog/large-language-model-llama-meta-ai/

Further Reading

• https://arxiv.org/abs/2302.13971