Qwen vs. RedPajama-INCITE

Overview

Qwen is Alibaba Cloud's family of large language models, including chat models, code models, and multimodal variants. Qwen 3 and QwQ are the latest releases, with strong reasoning capabilities.

Qwen (formerly Tongyi Qianwen) is a comprehensive family of large language models developed by Alibaba Cloud. The series includes base models, chat models, code-specific variants (CodeQwen), and multimodal models (Qwen-VL). Qwen models excel at multilingual tasks and have become particularly popular in Asia. The latest releases include Qwen 3 and QwQ (focused on reasoning), competing effectively with Western counterparts while offering strong Chinese language support.

Initial release: 2023-09-13

Reference

https://qwenlm.github.io/

Further Reading

• https://arxiv.org/abs/2309.16609
• https://huggingface.co/Qwen

Overview

RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.

Initial release: 2023-05-05

Reference

https://www.together.xyz/blog/redpajama-models-v1

Further Reading

• https://www.together.xyz/blog/redpajama-7b