Get started
LLM Index

Koala vs. MPT

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Koala MPT
Developer BAIR MosaicML
Current generation – –
Initial release 2023-04-03 2023-05-05
Instruct tuned Yes Yes
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Noncommercial Apache 2.0
Model sizes 7B, 13B 7B, 30B
Links

Koala

Released alongside Vicuna, Koala is one of many descendants of the Meta LLaMA model trained on dialogue data collected from the web. On the developers' benchmarks, Koala outperforms its sibling Alpaca, though its adoption has been significantly less than that of its other sibling, Vicuna. Due to its use of LLaMA, only research use is permitted.

MPT

MPT-7B and MPT-30B are a set of models that are part of MosaicML's Foundation Series. Trained on 1T tokens, the developers state that MPT-7B matches the performance of LLaMA while also being open source, while MPT-30B outperforms the original GPT-3. In addition to the base model, the developers also offer MPT-Instruct, MPT-Chat, and MPT-7B-StoryWriter-65k+, the last of which is trained on a context length of 65K tokens.

Further reading

Compare other models

Other Koala comparisons

Other MPT comparisons