all the models — AI benchmark observatory
← Models

GPT-4o

OpenAI · proprietary · gpt-4o-2024-08-06

GPT-4o ('o' for 'omni') is a multimodal AI model that accepts text, audio, image, and video inputs, and generates text, audio, and image outputs. It matches GPT-4 Turbo performance on text and code, with improvements in non-English languages, vision, and audio understanding.

AI2DDocVQAChartQAMMLUCharXiv-DIFEval

Benchmark scores

BenchmarkScore
AI2D0.94
DocVQA0.93
ChartQA0.86
MMLU0.86
CharXiv-D0.85
IFEval0.81
MMLU-Pro0.75
MMMU0.72
GPQA0.70
MMMU-Pro0.60
SWE-Bench Verified0.33
AIME 20240.13
Humanity's Last Exam0.05

Pricing

  • OpenAI$2.50 / $10.00
  • Azure$2.50 / $10.00

Input / output per 1M tokens

AA metrics

No Artificial Analysis link yet.

Arena Elo

  • No Arena snapshot linked.