Math benchmark comparison between Gemini Ultra and GPT-4 in 2024

Published by
Bergur Thormundsson,
Feb 16, 2024
Gemini Ultra and GPT-4 are the leading generative AI platforms worldwide, and they compare alike in the mathematical benchmarks. Gemini Ultra is slightly ahead of GPT-4, beating it in both mathematical benchmarks as well as the general MMLU benchmarking. The lead is not so significant as to consider GPT-4 a lackluster model.

Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024

© Statista 2024
Download
Show detailed source information?
Register for free
Already a member?
Log in
Source

Use Ask Statista Research Service

Release date

December 2023

Region

Worldwide

Survey time period

December 2023

Supplementary notes

Source notes: "GSM8K = Basic arithmetic manipulations (incl. Grade School math problems), MATH = Challenging math problems (incl. algebra, geometry, pre-calculus, and others)"

Source notes: "MMLU = Representation of questions in 57 subjects (incl. STEM, humanities, and others)"

Citation formats
Statista Accounts: Access All Statistics. Starting from $2,388 USD / Year
Basic Account
Get to know the platform

You only have access to basic statistics.
This statistic is not included in your account.

Starter Account
The ideal entry-level account for individual users
  • Instant access to 1m statistics
  • Download in XLS, PDF & PNG format
  • Detailed references
$199 USD / Month *
Professional Account
Full access

Business Solutions including all features.

* Prices do not include sales tax.

Statistics on " Generative artificial intelligence (AI) "

The most important statistics
The most important statistics
The most important statistics
The most important statistics
The most important statistics
The most important statistics

Other statistics that may interest you Generative artificial intelligence (AI)

Overview

4

Generative AI tools

3

Generative AI benchmarks

7

Generative AI developers

5

Generative AI use

3

Special focus: United States

5

Further Content: You might find this interesting as well

Topics

Generative artificial intelligence (AI)Artificial intelligence (AI) worldwideArtificial intelligence (AI) use in marketing ChatGPTBard
Statista Accounts: Access All Statistics. Starting from $2,388 USD / Year
Learn more about how Statista can support your business.
Menu