LMSYS, the ranking organization using Chatbot Arena, conducts a “battle” between two chatbots to answer the same questions and allows users to choose their preferred side. The latest report on January 26, 2024, reveals that Bard, using Gemini Pro, outperforms GPT-4 and becomes the superior AI, powering GPT-4 Turbo.
Google introduces Gemini, claiming it as the highest-quality free chatbot in the market, with closed beta testing conducted among selected testers. The experimental results indicate that Gemini performs exceptionally well overall.
Although Bard scores higher than Gemini Pro through the API, LMSYS did not pit Bard against Gemini Pro directly. This distinction arises from Google’s statement that Bard utilizes Gemini internally but tweaks the model to some extent and may update the model along the way. On the other hand, the API providers usually update their models periodically and notify developers in advance.
TLDR: In a head-to-head battle of chatbots, Bard, powered by Gemini Pro, surpasses GPT-4 and takes its place as the GPT-4 Turbo. However, direct comparison with Gemini Pro was not done, considering the differences in model customization and update approach between Bard and API providers.
Leave a Comment