GPT-5.6 Sol and Claude Opus 5 are now 0.4 points apart on the industry's toughest coding benchmark — the benchmark stopped being the decision

Independent benchmarking now has GPT-5.6 Sol and Claude Opus 5 within half a point of each other on Terminal-Bench 2.1 (89.5% vs 89.1%) — a gap small enough that raw model capability has stopped being a meaningful reason to pick one AI coding agent over another.

Artificial Analysis’s independent run of Terminal-Bench 2.1 — a benchmark that tests an AI model’s ability to navigate and complete real tasks in a sandboxed terminal — now has GPT-5.6 Sol (running at maximum reasoning effort) narrowly ahead of Claude Opus 5 (also at maximum effort): 89.5% versus 89.1%. Other independent benchmark runs put the gap slightly wider, and Claude Opus 5’s own scoring has been complicated by its use of Opus 4.8 as a refusal fallback on a handful of tasks. But every recent version of this leaderboard tells the same story: the top two frontier coding models are now within a point or two of each other, not the multi-point gaps that used to clearly separate a “best” model from the field.

This is a meaningfully different situation to six months ago, when picking a frontier model for a coding-heavy workload was, in large part, a benchmark-chasing exercise — pick whichever lab was ahead this quarter. That gap has now compressed to the point of statistical noise for most real-world purposes.

So what

When the top models are functionally tied on raw capability, the decision that actually determines outcomes moves elsewhere: which agent integrates best with your existing toolchain, which vendor’s default security posture and permission model fit your risk tolerance (see this week’s Black Hat disclosures for why that’s not a minor point), which pricing structure fits your usage pattern, and which team actually knows how to get consistent, well-scoped output out of the tool rather than impressive demo output. For a business commissioning AI-assisted development, that’s better news than it sounds — it means the choice of AI coding agent is no longer the highest-leverage decision in the project, the choice of team is. If you want a partner who picks tooling on that basis rather than chasing whichever model topped last month’s leaderboard, see our approach to AI-assisted development or get in touch to talk through your project.

← All research

More research.

GitHub's Copilot impact dashboard now counts chat and VS Code agent use, and drops the 'passive users' label

On 6 November 2026 GitHub added Copilot Chat and the VS Code Agents window to its Copilot impact dashboard, bringing it to nine tracked experiences, and renamed 'Passive users' to 'Chat-first users'.

Read ›

Claude Code 2.1.319: a setting that denies permission prompts so AI agent runs don't stall

Claude Code 2.1.319 (6 November 2026) adds a permissions.denyInsteadOfPrompting setting and moves long MCP tool calls to the background, a sign AI-assisted development is being built for unattended runs.

Read ›

GitHub now reports how often developers act on Copilot code review comments

On 5 November 2026 GitHub added code review metrics, including an addressed rate, to the Copilot usage metrics API. For AI software development buyers, it is the first first-party number for how much AI review feedback is acted on.

Read ›

Dependabot can now keep AI agent skills and prompts up to date

GitHub's Dependabot gained Agent Package Manager (APM) support on 3 November 2026, treating AI agent skills, prompts and instructions as dependencies that need updating like any other software.

Read ›

GitHub Copilot is now inside Xcode's own coding assistant: what iOS app owners should ask

GitHub put Copilot into Xcode's built-in coding assistant on 4 November 2026, in public preview with Xcode 27.3 beta. AI-assisted iOS app development is now a built-in choice of agent, not a plug-in.

Read ›

GitHub's Copilot usage API now separates bring-your-own-key and custom models: AI spend visibility for software buyers

GitHub's Copilot usage metrics API now reports bring-your-own-key (BYOK) and enterprise custom model usage separately, as of 3 November 2026. Teams using AI coding tools can see more of where usage goes.

Read ›

Start a project

Building with AI? Let's talk.

Tell us what you are building. We'll give you an honest view of the right approach.

Start a projectSee our work