Get started
LLM Index

Cerebras-GPT vs. FLAN-UL2

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Cerebras-GPT FLAN-UL2
Developer Cerebras Google
Current generation – –
Initial release 2023-03-28 2023-03-03
Instruct tuned No Yes
Coding No No
Finetuning Yes Yes
Open source Yes Yes
License Apache 2.0 Apache 2.0
Model sizes 1.3B, 2.7B, 6.7B, 13B 20B
Links

Cerebras-GPT

The Cerebras-GPT family of models was developed by the AI accelerator company Cerebras following Chinchilla scaling laws as a demonstration of its Wafter-Scale Cluster technology.

FLAN-UL2

Similar to FLAN-T5, FLAN-UL2 is a model based on Google's popular T5 architecture with an upgraded pre-training procedure dubbed UL2. On most NLU benchmarks, FLAN-UL2 outperforms FLAN-T5 by a significant margin.

Further reading

Compare other models

Other Cerebras-GPT comparisons

Other FLAN-UL2 comparisons