Pythia vs. Qwen

Overview

The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.

Initial release: 2023-02-13

Reference

https://github.com/EleutherAI/pythia

Further Reading

Overview

Qwen is Alibaba's broad family of open and hosted models for reasoning, coding, multimodal understanding, and agents. Qwen 3.8 Max Preview is the current generation.

Qwen, formerly Tongyi Qianwen, is a family of language and multimodal models developed by Alibaba. It includes general-purpose, coding, vision-language, audio, embedding, and reasoning variants. Qwen 3.8 Max Preview is the current hosted flagship, with support for multimodal and agentic workflows. Earlier Qwen generations, including Qwen 3.6 checkpoints, remain available as Apache 2.0 open weights; availability and licensing should therefore be checked per model.

Initial release: 2023-09-13

Current generation: Qwen 3.8

Reference

https://qwen.ai/

Further Reading

• https://arxiv.org/abs/2309.16609
• https://huggingface.co/Qwen
• https://qwen.ai/blog?id=qwen3.6-35b-a3b