all the models — AI benchmark observatory
← Models

Mistral Small 3.1 24B Instruct

Mistral AI · open weight · mistral-small-3.1-24b-instruct-2503

Building upon Mistral Small 3 (2501), Mistral Small 3.1 (2503) adds state-of-the-art vision understanding and enhances long context capabilities up to 128k tokens without compromising text performance. With 24 billion parameters, this model achieves top-tier capabilities in both text and vision tasks.

HumanEvalMMLUMATHMMLU-ProMMMUGPQA

Benchmark scores

BenchmarkScore
HumanEval0.88
MMLU0.81
MATH0.69
MMLU-Pro0.67
MMMU0.59
GPQA0.46

Pricing

  • No provider pricing.

AA metrics

No Artificial Analysis link yet.

Arena Elo

  • No Arena snapshot linked.