Dolly vs. MPT-7B
LLM Comparison
Overview
Dolly is an LLM trained using the Databricks machine learning platform. Originally released without instruct-finetuning, Dolly v2 included tuning on the Stanford Alpaca dataset.
Initial release: 2023-03-24
Further Reading
Overview
MPT-7B is a set of models that are part of MosaicML's Foundation Series. Trained on 1T tokens, the developers state that it matches the performance of LLaMA while also being open source. In addition to the base model, the developers also offer MPT-7B-Instruct, MPT-7B-Chat, and MPT-7B-StoryWriter-65k+, the last of which is trained on a context length of 65K tokens.
Initial release: 2023-05-05
Reference
Further Reading
Dolly |
MPT-7B |
|
|---|---|---|
| Products & Features | ||
| Instruct Models | ||
| Coding Capability | ||
| Customization | ||
| Finetuning | ||
| Open Source | ||
| License | MIT | Apache 2.0 |
| Model Sizes | 3B, 12B | 7B |