FLAN-UL2 vs. Gemma

Overview

Similar to FLAN-T5, FLAN-UL2 is a model based on Google's popular T5 architecture with an upgraded pre-training procedure dubbed UL2. On most NLU benchmarks, FLAN-UL2 outperforms FLAN-T5 by a significant margin.

Initial release: 2023-03-03

Reference

https://huggingface.co/google/flan-ul2

Further Reading

• https://www.yitay.net/blog/flan-ul2-20b

Overview

Gemma is Google's family of efficient open models for local, edge, and self-hosted deployment. Gemma 4 is the current generation, spanning mobile-scale through workstation-scale models.

Google introduced Gemma in February 2024 as a family of lightweight open models built from the same research used for Gemini. Gemma 2 improved efficiency and model quality, while Gemma 3 added multimodal input and longer context. Gemma 4, released in April 2026 under Apache 2.0, adds advanced reasoning, agentic tool use, code generation, image and video understanding, and models ranging from edge-focused E2B and E4B variants to 12B, 26B mixture-of-experts, and 31B dense checkpoints.

Initial release: 2024-02-21

Current generation: Gemma 4

Reference

https://ai.google.dev/gemma

Further Reading

• https://ai.google.dev/gemma/docs
• https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/