Gemma vs. MPT

Overview

Gemma is Google's family of efficient open models for local, edge, and self-hosted deployment. Gemma 4 is the current generation, spanning mobile-scale through workstation-scale models.

Google introduced Gemma in February 2024 as a family of lightweight open models built from the same research used for Gemini. Gemma 2 improved efficiency and model quality, while Gemma 3 added multimodal input and longer context. Gemma 4, released in April 2026 under Apache 2.0, adds advanced reasoning, agentic tool use, code generation, image and video understanding, and models ranging from edge-focused E2B and E4B variants to 12B, 26B mixture-of-experts, and 31B dense checkpoints.

Initial release: 2024-02-21

Current generation: Gemma 4

Reference

https://ai.google.dev/gemma

Further Reading

• https://ai.google.dev/gemma/docs
• https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/

Overview

MPT-7B and MPT-30B are a set of models that are part of MosaicML's Foundation Series. Trained on 1T tokens, the developers state that MPT-7B matches the performance of LLaMA while also being open source, while MPT-30B outperforms the original GPT-3. In addition to the base model, the developers also offer MPT-Instruct, MPT-Chat, and MPT-7B-StoryWriter-65k+, the last of which is trained on a context length of 65K tokens.

Initial release: 2023-05-05

Reference

https://www.mosaicml.com/blog/mpt-30b

Further Reading

• https://www.mosaicml.com/blog/mpt-7b
• https://huggingface.co/mosaicml