DeepSeek vs. FLAN-UL2

Overview

DeepSeek develops open-weight mixture-of-experts models for reasoning, coding, agents, and efficient long-context inference. DeepSeek V4 is the current generation.

DeepSeek began releasing language models in 2023 with DeepSeek Coder, then gained broad adoption with DeepSeek V3 and the R1 reasoning model in 2024 and 2025. DeepSeek V4, released in April 2026, includes a 284B-parameter Flash model with 13B active parameters and a 1.6T-parameter Pro model with 49B active parameters. Both support one-million-token context windows and are released with open weights under the MIT license.

Initial release: 2023-11-29

Current generation: DeepSeek V4

Reference

https://www.deepseek.com/

Further Reading

• https://api-docs.deepseek.com/news/news260424/
• https://huggingface.co/collections/deepseek-ai/deepseek-v4

Overview

Similar to FLAN-T5, FLAN-UL2 is a model based on Google's popular T5 architecture with an upgraded pre-training procedure dubbed UL2. On most NLU benchmarks, FLAN-UL2 outperforms FLAN-T5 by a significant margin.

Initial release: 2023-03-03

Reference

https://huggingface.co/google/flan-ul2

Further Reading

• https://www.yitay.net/blog/flan-ul2-20b