FLAN-UL2 vs. WizardLM
LLM Comparison
FLAN-UL2
Overview
Similar to FLAN-T5, FLAN-UL2 is a model based on Google's popular T5 architecture with an upgraded pre-training procedure dubbed UL2. On most NLU benchmarks, FLAN-UL2 outperforms FLAN-T5 by a significant margin.
Initial release: 2023-03-03
Reference
Further Reading
WizardLM
Overview
WizardLM is a variant of LLaMA trained with complex instructions.
WizardLM is a LLM based on LLaMA trained using a new method, called Evol-Instruct, on complex instruction data. By using AI to "evolve" instructions, WizardLM outperforms similar LLaMA-based LLMs trained on simpler instruction data. On the 6th of July, 2023, WizardLM V1.1 was released with significantly improved performance, and as of 15 April 2024, WizardLM-2 was released with state-of-the-art performance.
Initial release: 2023-05-26
Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.
Sapling APIMore Comparisons
FLAN-UL2 |
WizardLM |
|
|---|---|---|
| Products & Features | ||
| Instruct Models | ||
| Coding Capability | ||
| Customization | ||
| Finetuning | ||
| Open Source | ||
| License | Apache 2.0 | Noncommercial |
| Model Sizes | 20B | 7B, 13B, 70B, 8x22B |