BLOOMChat vs. RedPajama-INCITE

Overview

BLOOMChat is a variant of the BLOOM language model with instruction fine-tuning.

BLOOMChat is a 176 billion parameter language model based on BLOOM trained using SambaNova's Reconfigurable Data Units. Based on BLOOM, BLOOMChat is also multilingual, and provides a HuggingFace chat interface and model.

Initial release: 2023-05-19

Reference

https://sambanova.ai/blog/introducing-bloomchat-176b-the-multilingual-chat-based-llm/

Further Reading

• https://huggingface.co/spaces/sambanovasystems/BLOOMChat
• https://huggingface.co/sambanovasystems/BLOOMChat-176B-v1
• https://github.com/sambanova/bloomchat

Overview

RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.

Initial release: 2023-05-05

Reference

https://www.together.xyz/blog/redpajama-models-v1

Further Reading

• https://www.together.xyz/blog/redpajama-7b