OpenLLaMA vs. Pythia
LLM Comparison
OpenLLaMA
Overview
OpenLLaMA is an effort from OpenLM Research to offer a non-gated version of LLaMa that can be used both for research and commercial applications. As of June 2023, the model is still training, with 3B, 7B, and 13B parameter models available.
Initial release: 2023-04-28
Further Reading
Pythia
Overview
The most recent (as of May 2023) effort from EleutherAI, Pythia is a set of LLMs trained on The Pile. While it appears to outperform OPT and GPTNeo, its performance against GPT-J is unclear. Versions of Pythia have also been instruct-tuned by the team at Together.
Initial release: 2023-02-13
Reference
Further Reading
Looking for an LLM API/SDK that works out of the box? No prompts or ad hoc guardrails.
Sapling APIMore Comparisons
OpenLLaMA |
Pythia |
|
|---|---|---|
| Products & Features | ||
| Instruct Models | ||
| Coding Capability | ||
| Customization | ||
| Finetuning | ||
| Open Source | ||
| License | Apache 2.0 | Apache 2.0 |
| Model Sizes | 3B, 7B, 13B | 1B, 1.4B, 2.8B, 6.9B, 12B |