Get started
LLM Index

Phi vs. RedPajama-INCITE

A side-by-side comparison of release history, capabilities, licensing and model sizes.

Attribute Phi RedPajama-INCITE
Developer Microsoft Together
Current generation Phi-4 –
Initial release 2023-06-20 2023-05-05
Instruct tuned Yes Yes
Coding Yes No
Finetuning Yes Yes
Open source Yes Yes
License MIT Apache 2.0
Model sizes 3.8B, 5.6B, 14B 3B, 7B
Links

Phi

Phi is Microsoft's family of compact open models designed for efficient local and edge deployment. Phi-4 is the current generation.

Microsoft introduced Phi-1 and Phi-2 to demonstrate how carefully curated and synthetic training data can make small models unusually capable. Phi-3 expanded the family for mobile and multimodal use. The Phi-4 generation includes a 14B general model and reasoning variants, plus smaller and multimodal checkpoints. Phi models are released under the MIT license and are designed for research, local inference, and resource-constrained production workloads.

Further reading

RedPajama-INCITE

RedPajama-INCITE is the first family of models trained on the RedPajama base dataset. The goal of the RedPajama-INCITE models is to replicate the LLaMA recipe but make the model fully open source under the Apache license. As of the initial release, the 3B parameter model is best-in-class, with the 7B parameter model in progress. Update as of June 6, 2023: the 7B parameter model was made available, outperforming other models of the same size.

Further reading

Compare other models

Other Phi comparisons

Other RedPajama-INCITE comparisons