Pythia vs. Qwen

Overview

The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.

Initial release: 2023-02-13

Reference

https://github.com/EleutherAI/pythia

Further Reading

Overview

Qwen is Alibaba Cloud's family of large language models, including chat models, code models, and multimodal variants. Qwen 3 and QwQ are the latest releases, with strong reasoning capabilities.

Qwen (formerly Tongyi Qianwen) is a comprehensive family of large language models developed by Alibaba Cloud. The series includes base models, chat models, code-specific variants (CodeQwen), and multimodal models (Qwen-VL). Qwen models excel at multilingual tasks and have become particularly popular in Asia. The latest releases include Qwen 3 and QwQ (focused on reasoning), competing effectively with Western counterparts while offering strong Chinese language support.

Initial release: 2023-09-13

Reference

https://qwenlm.github.io/

Further Reading

• https://arxiv.org/abs/2309.16609
• https://huggingface.co/Qwen