Sapling Logo

FastChat vs. OPT

LLM Comparison


FastChat

FastChat

Overview

FastChat is the open platform for training, serving, and evaluating LLM chatbots developed and maintained by LMSYS.


FastChat is an open-source library for training, serving, and evaluating LLM chat systems from LMSYS. It includes training and evaluation code, a model serving system, a Web GUI, and a finetuning pipeline, and is the de facto system for Vicuna as well as FastChat-T5. FastChat also includes the Chatbot Arena for benchmarking LLMs.


Initial release: 2023-04-28

OPT

OPT

Overview

Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.



Initial release: 2022-05-03

Further Reading

Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.

Sapling API
More Comparisons

FastChat

OPT

Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 NA
Model Sizes 3B 1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B