LLM: Gemma 2
- Developer
-
Google
- Initial Release
-
2024-06-27 - Overview
- Gemma 2 succeeds the Gemma family of lightweight open models from Google built using the same processes used for the the larger Gemini models.
- Description
- Gemma 2 is the successor to the Gemma family of open models, including larer models (9B and 27B parameters) with outsized performance across benchmarks. Using a combination of techniques such as training on twice as much data, knowledge distillation, and architectural improvements such as sliding window attention, logit soft-capping, and model merging, Gemma 2 outperforms models of similar size (such as Llama 3), with the 27B parameter model being competitive with models more than twice its size (such as Llama 70B).
- Open Source
- Yes
- Instruct Tuned
- Yes
- Model Sizes
-
2.6B, 9B, 27B - Finetuning
- Yes
- License
- Custom
- Pricing
- -
- Link
- Visit
- Further Reading
Unsure? Contact us with a brief description of your use case if you'd like for us to make a snap assessment. Depending on your requirements, a smaller, custom language model may even be the best option.