OpenAssistant vs. RedPajama-INCITE

Overview

OpenAssistant is a project organized by LAION with aim of providing an open source alternative to ChatGPT. Its primary effort is to collected instruct examples to then tune existing LLMs. The first major release is available as part of Hugging Face's HuggingChat.

Initial release: 2023-04-15

Reference

https://open-assistant.io/

Further Reading

• https://www.youtube.com/watch?v=ddG2fM9i4Kk

Overview

RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.

Initial release: 2023-05-05

Reference

https://www.together.xyz/blog/redpajama-models-v1

Further Reading

• https://www.together.xyz/blog/redpajama-7b