FastChat vs. Vicuna

Overview

FastChat is the open platform for training, serving, and evaluating LLM chatbots developed and maintained by LMSYS.

FastChat is an open-source library for training, serving, and evaluating LLM chat systems from LMSYS. It includes training and evaluation code, a model serving system, a Web GUI, and a finetuning pipeline, and is the de facto system for Vicuna as well as FastChat-T5. FastChat also includes the Chatbot Arena for benchmarking LLMs.

Initial release: 2023-04-28

Reference

https://github.com/lm-sys/FastChat

Further Reading

• https://chat.lmsys.org/
• https://lmsys.org/projects/

Overview

Released alongside Koala, Vicuna is one of many descendants of the Meta LLaMA model trained on dialogue data collected from the ShareGPT website. According to the authors, Vicuna achieves more than 90% of ChatGPT's quality in user preference tests, while vastly outperforming Alpaca. As of May 2023, Vicuna seems to be the heir apparent of the instruct-finetuned LLaMA model family, though it is also restricted from commercial use.

Initial release: 2023-03-30

Reference

https://vicuna.lmsys.org/

Further Reading

• https://lmsys.org/blog/2023-03-30-vicuna/