CursorBench 3.1

We evaluate agents on ambiguous, multi-file tasks from real Cursor sessions. Higher scores are better.

More about CursorBench
A scatter and line chart comparing Fable 5, Opus 4.8, Opus 4.7, GPT-5.5, Sonnet 4.6, Composer 2.5, and Composer 2 scores against average cost per task.75% CursorBench 3.1 score70%65%60%55%50%45%40%35%30%$20$16$12$8$4$0Average cost per taskFable 5 high(default)Composer 2.5GPT-5.5 medium(default)Gemini 3.5 FlashOpus 4.8 high(default)Sonnet 4.6 high(default)Kimi 2.6
Model
1Fable 5 Max72.9%$18.0263,84276
2Fable 5 Extra High72.0%$13.7448,75463
3Fable 5 High70.6%$10.8137,17354
4Fable 5 Medium69.8%$8.2728,50747
5Opus 4.7 Max64.8%$11.0262,98996
6GPT-5.5 Extra High64.3%$4.3717,90546
7Fable 5 Low64.2%$5.7018,88236
8Opus 4.8 Max63.8%$7.5977,37060
9Composer 2.563.2%$0.5515,15237
10GPT-5.5 High62.6%$3.5913,32940
11Opus 4.8 Extra High62.1%$6.1455,62254
12Opus 4.7 Extra High61.6%$7.1143,94272
13Opus 4.7 High59.4%$5.0132,22759
14GPT-5.5 Medium59.2%$2.229,06535
15Opus 4.8 High58.4%$4.4136,78845
16Opus 4.8 Medium56.6%$3.8331,68441
17Opus 4.8 Low54.3%$2.9322,72636
18Opus 4.7 Medium52.7%$2.9319,19341
19Composer 252.2%$0.5614,16340
20Gemini 3.5 Flash49.8%$1.9435,10579
21Sonnet 4.6 Max49.0%$3.0940,28055
22GPT-5.5 Low48.8%$1.194,92324
23Sonnet 4.6 High48.8%$3.0637,35257
24Opus 4.7 Low48.3%$1.8713,16429
25Kimi 2.647.6%$1.2724,78356
26Sonnet 4.6 Medium46.0%$2.6431,36050
27Sonnet 4.6 Low41.5%$1.8921,21150
28Kimi 2.531.9%$0.879,44630

Changelog

CursorBench 3.1

  • Introduced problems focused on codebase understanding, bugfinding, planning, and code review.
  • Improved grading criteria for some edit tasks.

CursorBench 3.0

  • Initial set of tasks focused on edit, refactor, and bugfix problems.

Avg cost / task is computed by applying each model's published per-million-token pricing (input, cache read, cache write, and output) to the tokens it used on each CursorBench 3.1 task, then averaging across tasks. Results are subject to variance; small differences in scores may not be statistically meaningful.