Get started
LLM Index

MPT vs. OpenLLaMA

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute MPT OpenLLaMA
Developer MosaicML OpenLM Research
Current generation – –
Initial release 2023-05-05 2023-04-28
Instruct tuned Yes No
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 Apache 2.0
Model sizes 7B, 30B 3B, 7B, 13B
Links

MPT

MPT-7B and MPT-30B are a set of models that are part of MosaicML's Foundation Series. Trained on 1T tokens, the developers state that MPT-7B matches the performance of LLaMA while also being open source, while MPT-30B outperforms the original GPT-3. In addition to the base model, the developers also offer MPT-Instruct, MPT-Chat, and MPT-7B-StoryWriter-65k+, the last of which is trained on a context length of 65K tokens.

Further reading

OpenLLaMA

OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.

Further reading

Compare other models

Other MPT comparisons

Other OpenLLaMA comparisons