all the models — AI benchmark observatory
← Models

Gemini 1.5 Pro

Google · proprietary · gemini-1.5-pro

Gemini 1.5 Pro is a mid-size multimodal model optimized for a wide range of reasoning tasks. It can process large amounts of data at once, including 2 hours of video, 19 hours of audio, codebases with 60,000 lines of code, or 2,000 pages of text.

HellaSwagGSM8kBIG-Bench HaMATHMMLUHumanEval

Benchmark scores

BenchmarkScore
HellaSwag0.93
GSM8k0.91
BIG-Bench Hard0.89
MATH0.86
MMLU0.86
HumanEval0.84
MMLU-Pro0.76
MMMU0.66
GPQA0.59

Pricing

  • No provider pricing.

AA metrics

No Artificial Analysis link yet.

Arena Elo

  • No Arena snapshot linked.
Gemini 1.5 Pro Benchmarks · all the models