Grok vs. Mistral

Overview

Grok is a mixture-of-experts model offered by xAI.

Grok is the flagship language model of xAI, the AI company founded by Elon Musk with close ties to X.com (FKA Twitter). Grok-1 was initialized released late in 2023 and later open-sourced in March of 2024. On March 28, 2024, Grok-1.5 was released with significantly better performance and a context length of 128,000 tokens.

Initial release: 2023-11-05

Reference

https://huggingface.co/xai-org/grok-1

Further Reading

• https://github.com/xai-org/grok-1/tree/main

Overview

Developed by some of the researchers behind Llama, the Mistral large language models are the gold standard for accessible and performant open source models.

Mistral AI offers 7B and a mixture-of-experts 8x7B open source models competitive or better than commercial models of similar size. Available under the Apache 2.0 license, the Mistral models are now also available via most cloud vendors. After releasing their open source models, Mistral AI has also begun offering Small, Large, and Embed models via their business API.

Initial release: 2023-09-27

Reference

https://mistral.ai/technology/#models

Further Reading

• https://mistral.ai/news/announcing-mistral-7b/
• https://mistral.ai/news/mixtral-of-experts/