all the models — AI benchmark observatory
← Models

Mistral Small 3 24B Base

Mistral AI · open weight · mistral-small-24b-base-2501

Mistral Small 3 is competitive with larger models such as Llama 3.3 70B or Qwen 32B, and is an excellent open replacement for opaque proprietary models like GPT4o-mini. Mistral Small 3 is on par with Llama 3.3 70B instruct, while being more than 3x faster on the same hardware.

MMLUMMLU-ProMATHGPQA

Benchmark scores

BenchmarkScore
MMLU0.81
MMLU-Pro0.54
MATH0.46
GPQA0.34

Pricing

  • No provider pricing.

AA metrics

No Artificial Analysis link yet.

Arena Elo

  • No Arena snapshot linked.