The model achieved a 40.0% score on FrontierCode 2.0, a benchmark that measures quality and mergeability on real‑world engineering tasks. That score exceeds Gemini 4 Argon’s 26.3% and is slightly higher than GPT‑6.1 Sol’s 39.0%.
Devin said the improvement comes with a lower cost. At low reasoning effort, Gemini 4 Carbon’s top score costs less than two‑thirds as much per task as Gemini 4 Argon’s best result, based on mean USD spend per rollout at list API pricing with public discounts.
The score is a weighted aggregate of rubric items, and solutions that fail blocking criteria receive a zero.
Sources
Fan coverage from Devin Central — not an official Cognition announcement. Devin is a trademark of Cognition.