all the models — AI benchmark observatory
← Benchmarks

CRUXEval-Input-CoT

CRUXEval input prediction task with Chain of Thought (CoT) prompting. Part of the CRUXEval benchmark for code reasoning, understanding, and execution evaluation. Given a Python function and its expected output, the task is to predict the appropriate input using chain-of-thought reasoning. Consists of 800 Python functions (3-13 lines) designed to evaluate code comprehension and reasoning capabilities.

id cruxeval-input-cot · max 1 · 1 models reported

#ModelScore

No scores for this benchmark yet.