← Benchmarks
MBPP
MBPP (Mostly Basic Python Problems) is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers. Each problem consists of a task description, code solution, and 3 automated test cases covering programming fundamentals and standard library functionality.
id mbpp · max 100 · 33 models reported
| # | Model | Score |
|---|---|---|
| 1 | Sarvam-30B Sarvam AI · open | 0.93 |
