LLM: RedPajama-INCITE

Developer

Together

Initial Release

2023-05-05

Overview

RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.

Description

Open Source

Yes

Instruct Tuned

Yes

Model Sizes

3B, 7B

Finetuning

Yes

License

Apache 2.0

Pricing

-

Link

Visit

Further Reading

• https://www.together.xyz/blog/redpajama-7b

Unsure? Contact us with a brief description of your use case if you'd like for us to make a snap assessment. Depending on your requirements, a smaller, custom language model may even be the best option.