OSWorld 2.1 (strict)

Strict pass rate on OSWorld 2.1: fraction of tasks where every graded checkpoint is satisfied. Separate from the OSWorld 2.1 partial-credit score and from OSWorld 2.0.

id osworld-2.1-strict · max 1 · 1 models reported