← Benchmarks
MBPP Plus
MBPP (Mostly Basic Python Problems) is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers. Each problem consists of a task description, code solution, and 3 automated test cases covering programming fundamentals and standard library functionality. This is an enhanced version with additional test cases for more rigorous evaluation.
id mbpp-plus · max 1 · 1 models reported
| # | Model | Score |
|---|---|---|
| 1 | Mistral Small 3.2 24B Instruct Mistral AI · open | 0.78 |
