Gemini (FKA Bard) vs. ChatGPT

Overview

Gemini is Google's LLM chat product, based on its Bard model, which was based on its Pathways Language Model (PaLM) which succeeded LaMDA. Originally released with limited capabilities, Bard became increasingly capable in the second half of 2023. Bard built upon Google's research in the transformer architecture, Gopher scaling, Chinchilla compute-optimal scaling, and Sparrow dialogue finetuning. As the successor to Bard, Gemini achieves GPT-4-level performance along with the ability to write code and process images.

Initial release: 2023-03-21

Reference

https://bard.google.com

Further Reading

• https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html
• https://www.deepmind.com/publications/an-empirical-analysis-of-compute-optimal-large-language-model-training
• https://www.deepmind.com/blog/building-safer-dialogue-agents
• https://blog.google/technology/ai/google-gemini-ai/#availability

Overview

The engine behind the fastest growing product of all time, ChatGPT is the successor to OpenAI's InstructGPT model. Originally based on GPT-3, ChatGPT now provides options for users to either use its GPT-3.5 or GPT-4 base model. In mid-2024, GPT-4o with multimodal support was released, topping various benchmarks. Following 4o, o1 and its successor o3 were released as reasoning models with adaptive inference-time compute.

Initial release: 2022-11-30

Reference

https://chatgpt.com

Further Reading

• https://openai.com/blog/chatgpt
• https://openai.com/research/instruction-following