Sapling Logo

FLAN-T5 vs. OPT

LLM Comparison

FLAN-T5

Overview

FLAN-T5 is a finetuned version of Google's popular T5 model with instruct-finetuning. As stated in the model repository's introduction, compared to T5, FLAN-T5 is "just better at everything." With its permissive license, FLAN-T5 has become a popular option for a starting instruct model.

Initial release: 2022-12-06

Reference

https://huggingface.co/docs/transformers/model_doc/flan-t5

Further Reading

OPT

Overview

Open Pre-trained Transformer Language Models (OPT) is part of the family of open source models designed to replicate GPT-3, with similar decoder-only architecture. It has since been superseded by models such as LLaMA, GPT-J, and Pythia.

Initial release: 2022-05-03

Reference

https://github.com/facebookresearch/metaseq/tree/main/projects/OPT

Further Reading

Looking for an LLM API/SDK that works out of the box?

Sapling API
More Comparisons

FLAN-T5

OPT
Products & Features
Instruct Models
Coding Capability
Customization
Finetuning
Open Source
License Apache 2.0 NA
Model Sizes 3B, 11B 1.3B, 2.7B, 6.7B, 13B, 30B, 66B, 175B

Other FLAN-T5 Comparisons

FLAN-T5 vs. Alpaca FLAN-T5 vs. BLOOM FLAN-T5 vs. Cerebras-GPT FLAN-T5 vs. Dolly FLAN-T5 vs. FLAN-UL2 FLAN-T5 vs. GPT-J FLAN-T5 vs. GPT4All FLAN-T5 vs. GPTNeo FLAN-T5 vs. Koala FLAN-T5 vs. LLaMA FLAN-T5 vs. MPT-7B FLAN-T5 vs. OpenAssistant FLAN-T5 vs. OpenLLaMA FLAN-T5 vs. OPT FLAN-T5 vs. Pythia FLAN-T5 vs. RedPajama-INCITE FLAN-T5 vs. StableLM FLAN-T5 vs. StableVicuna FLAN-T5 vs. Vicuna

Other OPT Comparisons

OPT vs. Alpaca OPT vs. BLOOM OPT vs. Cerebras-GPT OPT vs. Dolly OPT vs. FLAN-T5 OPT vs. FLAN-UL2 OPT vs. GPT-J OPT vs. GPT4All OPT vs. GPTNeo OPT vs. Koala OPT vs. LLaMA OPT vs. MPT-7B OPT vs. OpenAssistant OPT vs. OpenLLaMA OPT vs. Pythia OPT vs. RedPajama-INCITE OPT vs. StableLM OPT vs. StableVicuna OPT vs. Vicuna

Undecided?

Get Advice