StableLM vs. StableVicuna

Overview

The StableLM series of language models is Stability AI's entry into the LLM space. Trained on The Pile, the initial release included 3B and 7B parameter models with larger models on the way.

Initial release: 2023-04-19

Reference

https://github.com/Stability-AI/StableLM

Further Reading

• https://news.ycombinator.com/item?id=35629127

Overview

StableVicuna is an RLHF finetune of Vicuna using datasets such as the OpenAssistant Conversations Dataset and the GPT4All Prompt Generations dataset.

Initial release: 2023-04-28

Reference

https://huggingface.co/CarperAI/stable-vicuna-13b-delta

Further Reading

• https://stability.ai/blog/stablevicuna-open-source-rlhf-chatbot