Get started
LLM Index

FastChat vs. Pythia

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute FastChat Pythia
Developer LMSYS EleutherAI, Together
Current generation – –
Initial release 2023-04-28 2023-02-13
Instruct tuned Yes No
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 Apache 2.0
Model sizes 3B 1B, 1.4B, 2.8B, 6.9B, 12B
Links

FastChat

FastChat is the open platform for training, serving, and evaluating LLM chatbots developed and maintained by LMSYS.

FastChat is an open-source library for training, serving, and evaluating LLM chat systems from LMSYS. It includes training and evaluation code, a model serving system, a Web GUI, and a finetuning pipeline, and is the de facto system for Vicuna as well as FastChat-T5. FastChat also includes the Chatbot Arena for benchmarking LLMs.

Further reading

Pythia

The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.

Compare other models

Other FastChat comparisons

Other Pythia comparisons