all the models — AI benchmark observatory
← Benchmarks

MBPP Plus

MBPP (Mostly Basic Python Problems) is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers. Each problem consists of a task description, code solution, and 3 automated test cases covering programming fundamentals and standard library functionality. This is an enhanced version with additional test cases for more rigorous evaluation.

id mbpp-plus · max 1 · 1 models reported

#ModelScore
1Mistral Small 3.2 24B Instruct
Mistral AI · open
0.78
MBPP Plus Leaderboard · all the models