MATH-500

MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.

id math-500 · max 1 · 33 models reported

#	Model	Score
1	LongCat-Flash-Thinking Meituan · open	0.99
2	Sarvam-105B Sarvam AI · open	0.99
3	GLM-4.5 Zhipu AI · open	0.98
4	GLM-4.5-Air Zhipu AI · open	0.98
5	Nemotron Nano 9B v2 NVIDIA · open	0.98
6	Kimi K2 Instruct Moonshot AI · open	0.97
7	Kimi K2-Instruct-0905 Moonshot AI · open	0.97
8	Llama 3.1 Nemotron Ultra 253B v1 NVIDIA · open	0.97
9	Sarvam-30B Sarvam AI · open	0.97
10	LongCat-Flash-Lite Meituan · open	0.97
11	MiniMax M1 80K MiniMax · open	0.97
12	Qwen3 14B Alibaba Cloud / Qwen Team · open	0.97
13	Llama-3.3 Nemotron Super 49B v1 NVIDIA · open	0.97
14	LongCat-Flash-Chat Meituan · open	0.96
15	Claude 3.7 Sonnet Anthropic	0.96
16	Kimi-k1.5 Moonshot AI	0.96
17	MiniMax M1 40K MiniMax · open	0.96
18	DeepSeek R1 Zero DeepSeek · open	0.96
19	Llama 3.1 Nemotron Nano 8B V1 NVIDIA · open	0.95
20	Phi 4 Mini Reasoning Microsoft · open	0.95
21	DeepSeek R1 Distill Llama 70B DeepSeek · open	0.94
22	DeepSeek R1 Distill Qwen 32B DeepSeek · open	0.94
23	DeepSeek-V3 0324 DeepSeek · open	0.94
24	DeepSeek R1 Distill Qwen 14B DeepSeek · open	0.94
25	DeepSeek R1 Distill Qwen 7B DeepSeek · open	0.93
26	QwQ-32B Alibaba Cloud / Qwen Team · open	0.91
27	QwQ-32B-Preview Alibaba Cloud / Qwen Team · open	0.91
28	DeepSeek-V3 DeepSeek · open	0.90
29	o1-mini OpenAI	0.90
30	DeepSeek R1 Distill Llama 8B DeepSeek · open	0.89