all the models — AI benchmark observatory
← Models

GPT-4o mini

OpenAI · proprietary · gpt-4o-mini-2024-07-18

GPT-4o mini is OpenAI's latest cost-efficient small model, designed to make AI intelligence more accessible and affordable. It excels in textual intelligence and multimodal reasoning, outperforming previous models like GPT-3.5 Turbo. With a context window of 128K tokens and support for text and vision, it offers low-cost, real-time applications such as customer support chatbots. Priced at 15 cents per million input tokens and 60 cents per million output tokens, it is significantly cheaper than its predecessors. Safety is prioritized with built-in measures and improved resistance to security threats.

HumanEvalMMLUMATHMMMUGPQASWE-Bench Ve

Benchmark scores

BenchmarkScore
HumanEval0.87
MMLU0.82
MATH0.70
MMMU0.59
GPQA0.40
SWE-Bench Verified0.09

Pricing

  • No provider pricing.

AA metrics

No Artificial Analysis link yet.

Arena Elo

  • No Arena snapshot linked.