Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Google's new AI technology could be smarter than OpenAI's GPT-4

Dec 09, 2023 - businessinsider.com
Google has unveiled Gemini, an AI model that rivals OpenAI's GPT-4. The most advanced version of Gemini, Gemini Ultra, outperforms GPT-4 in several areas including knowledge of subjects such as history and law, generating Python code, and tasks requiring multi-step reasoning. Google also claims that Gemini Ultra is the first model to match human-level experts in a test of 57 subject areas, scoring 90% on the Massive Multitask Language Understanding (MMLU) test, compared to GPT-4's 86.4% and human experts' 89.8%.

Gemini Ultra's design allows it to process several types of data, from text to audio to code to images and video, which Google claims gives it an advantage over other models. However, GPT-4 did outperform Gemini Ultra in common sense reasoning abilities for everyday tasks. Early reactions to the less advanced Gemini Pro have been positive, but it has had issues with accuracy and hallucinations. It remains to be seen how the trio of Gemini models will fare against OpenAI's GPT-4.

Key takeaways:

  • Google unveiled Gemini, a rival to OpenAI's GPT-4, which outperforms GPT-4 in math, coding, and subject knowledge at its most advanced tier.
  • The most advanced model, Gemini Ultra, is not available to the public yet, but it outperforms GPT-4 in several areas and is the first model to outperform human experts on the Massive Multitask Language Understanding (MMLU) test.
  • Gemini Ultra is natively multimodal, designed to process several types of data, from text to audio to code to images and video.
  • Early reactions to the less advanced Gemini Pro, accessible through Google's chatbot Bard, have been positive, but there have been issues with accuracy and hallucinations.
View Full Article

Comments (0)

Be the first to comment!