CursorBench 4.0

We evaluate agents on ambiguous, multi-file tasks from real Cursor sessions. Higher scores are better.

More about CursorBench
A scatter and line chart comparing Fable 5.2, Fable 5.1, Opus 5.5, Opus 5, Grok 4.7, Grok 4.6, GPT-5.6 Sol, GPT-5.6 Terra, GPT-5.6 Luna, Sonnet 5.5, Sonnet 5, Haiku 5.5, Gemini 4 Carbon, Gemini 4 Argon, Gemini 3.8 Flash, Muse Wonder, Muse Spark 1.3, GLM 5.3, GLM 5.3 Flash, DeepSeek V4.1 Flash 1017, and Composer 2.5 scores against average cost per task.65%CursorBench 4.0 score60%55%50%45%40%35%30%25%20%$16$12$8$4$0Average cost per taskGemini 4 CarbonFable 5.2Gemini 4 ArgonOpus 5.5Sonnet 5.5Muse WonderHaiku 5.5GPT-5.6 SolGrok 4.7
Model
1Gemini 4 Carbon High60.4%$9.2239,96071
2Gemini 4 Carbon Medium60.1%$8.4937,06767
3Fable 5.2 Max60.0%$32.79352,794218
4Gemini 4 Carbon Low58.6%$11.8942,663124
5Opus 5.5 Max57.8%$13.43218,363185
6Fable 5.2 High56.9%$9.7099,25969
7Fable 5.2 Extra High56.3%$15.48161,251108
8Opus 5.5 Extra High56.0%$6.98101,083109
9Opus 5.5 High56.0%$3.9753,07868
10Sonnet 5.5 Max55.5%$7.05271,920170
11Fable 5.2 Medium54.8%$4.6644,10335
12Fable 5.2 Low53.2%$3.9436,61630
13Sonnet 5.5 Extra High53.1%$2.81100,15878
14Gemini 4 Argon High52.9%$4.57109,500118
15Gemini 4 Argon Medium52.8%$4.39103,600115
16Opus 5.5 Medium52.5%$2.9137,95454
17Fable 5.1 Max51.8%$17.28117,236128
18Fable 5.1 Extra High51.6%$13.0187,294101
19Gemini 4 Argon Low50.6%$4.0994,200110
20Muse Wonder Max50.4%$5.2549,692114
21Fable 5.1 High49.2%$9.0858,43877
22Haiku 5.5 Max48.4%$1.12325,934163
23Muse Wonder Extra High48.2%$4.2439,56496
24Sonnet 5.5 High47.8%$1.2037,39141
25DeepSeek V4.1 Flash 1017 Max47.7%$0.98537,047187
26Fable 5.1 Medium46.8%$7.0545,41163
27Opus 5 Max46.6%$11.9585,384106
28Grok 4.7 Extra High46.3%$6.0170,14188
29DeepSeek V4.1 Flash 1017 Medium46.3%$0.80398,255189
30Opus 5 Extra High46.1%$11.4380,094103
31Muse Wonder High46.1%$3.5133,61284
32DeepSeek V4.1 Flash 1017 High45.6%$0.77385,196186
33Muse Wonder Medium45.2%$2.8227,12475
34Fable 5.1 Low45.1%$5.4434,79551
35DeepSeek V4.1 Flash 1017 Low44.9%$0.60290,651161
36Opus 5 High44.7%$9.0061,40586
37Haiku 5.5 Extra High44.3%$0.56143,81393
38Grok 4.7 High43.9%$4.6956,38271
39Opus 5.5 Low43.7%$1.1715,81128
40Opus 5 Medium43.3%$6.9445,27272
41GLM 5.3 Max42.6%$5.0596,387166
42Haiku 5.5 High42.3%$0.3277,05759
43GPT-5.6 Sol Max41.7%$8.2342,94499
44Muse Wonder Low41.7%$1.9118,88056
45Grok 4.7 Medium41.6%$3.4936,68360
46Muse Spark 1.3 Max41.6%$2.6452,00598
47Grok 4.6 Extra High41.4%$6.1049,81456
48GPT-5.6 Terra Max41.3%$5.1460,814107
49Opus 5 Low40.7%$4.8731,99557
50Grok 4.6 High40.4%$5.2041,38748
51Gemini 3.8 Flash High39.6%$4.70162,565324
52Sonnet 5.5 Medium39.2%$0.5216,03622
53GLM 5.3 High38.0%$3.2460,031114
54GPT-5.6 Sol Extra High37.7%$4.4024,72955
55Muse Spark 1.3 Extra High37.5%$2.1040,89183
56Gemini 3.8 Flash Medium37.3%$4.06128,364290
57Haiku 5.5 Medium36.9%$0.1742,65939
58GLM 5.3 Flash Max36.8%$0.3956,410118
59Grok 4.6 Medium36.1%$3.4824,89340
60GPT-5.6 Luna Max35.9%$1.0387,284208
61Sonnet 5.5 Low35.8%$0.3711,66818
62GPT-5.6 Sol High35.7%$2.8516,17441
63Muse Wonder Minimal34.2%$0.849,76133
64Sonnet 5 Max34.1%$7.17149,257140
65GPT-5.6 Terra Extra High33.6%$1.8123,43643
66Grok 4.6 Low33.4%$2.2516,30732
67Muse Spark 1.3 High33.4%$1.6630,65469
68GLM 5.3 Low33.3%$2.0431,98381
69Grok 4.7 Low33.1%$1.5815,67740
70GPT-5.6 Luna Extra High33.0%$0.4440,59898
71Muse Spark 1.3 Medium32.6%$1.4927,25564
72Sonnet 5 Extra High32.0%$4.5583,373102
73GPT-5.6 Sol Medium31.1%$1.7710,11132
74GLM 5.3 Flash High31.1%$0.2535,10484
75Haiku 5.5 Low30.9%$0.0823,38225
76Sonnet 5 High30.8%$3.4861,14685
77GPT-5.6 Terra High30.7%$1.1113,16233
78GPT-5.6 Luna High29.4%$0.2523,36864
79Muse Spark 1.3 Low29.3%$0.9317,48347
80Sonnet 5 Medium28.0%$2.3139,11465
81Composer 2.527.7%$0.6817,34741
82GPT-5.6 Terra Medium27.6%$0.647,30725
83GLM 5.3 Flash Low26.9%$0.1517,83158
84GPT-5.6 Terra Low25.2%$0.525,91423
85GPT-5.6 Sol Low24.6%$0.874,88521
86Muse Spark 1.3 Minimal24.3%$0.5610,62034
87Sonnet 5 Low24.1%$1.3923,77246
88GPT-5.6 Luna Medium22.2%$0.087,64232
89GPT-5.6 Luna Low16.0%$0.033,28818

Changelog

Reporting

  • Updated Sonnet 5.5 results to account for adjusted pricing.

Tasks

  • CursorBench 4.0
    • Introduced new long-horizon problems focused on edit, refactor, investigation, intent understanding, managing jobs, and design adherence.

Reporting

  • Updated Sonnet 5 results to account for adjusted pricing.

Reporting

  • Updated GPT-5.6 Terra and Luna results to account for adjusted pricing.

Reporting

  • Updated GPT-5.6 Sol, Terra, and Luna results to account for cache write costs.

Tasks

  • CursorBench 3.2
    • Introduced instruction following and advanced tool use problems.

Tasks

  • CursorBench 3.1
    • Introduced problems focused on codebase understanding, bugfinding, planning, and code review.
    • Improved grading criteria for some edit tasks.

Tasks

  • CursorBench 3.0
    • Initial set of tasks focused on edit, refactor, and bugfix problems.

Avg cost / task is computed by applying each model's published per-million-token pricing (input, cache read, cache write, and output) to the tokens it used on each task. Results are subject to variance; small differences in scores may not be statistically meaningful.