MPT vs. OpenAssistant

Overview

MPT-7B and MPT-30B are a set of models that are part of MosaicML's Foundation Series. Trained on 1T tokens, the developers state that MPT-7B matches the performance of LLaMA while also being open source, while MPT-30B outperforms the original GPT-3. In addition to the base model, the developers also offer MPT-Instruct, MPT-Chat, and MPT-7B-StoryWriter-65k+, the last of which is trained on a context length of 65K tokens.

Initial release: 2023-05-05

Reference

https://www.mosaicml.com/blog/mpt-30b

Further Reading

• https://www.mosaicml.com/blog/mpt-7b
• https://huggingface.co/mosaicml

Overview

OpenAssistant is a project organized by LAION with aim of providing an open source alternative to ChatGPT. Its primary effort is to collected instruct examples to then tune existing LLMs. The first major release is available as part of Hugging Face's HuggingChat.

Initial release: 2023-04-15

Reference

https://open-assistant.io/

Further Reading

• https://www.youtube.com/watch?v=ddG2fM9i4Kk