All writing

The Artisan's Playbook

Engineering Metrics in 2026: Reading DORA and DevEx as System Signals

April 9, 2026

The Problem With How These Metrics Get Used

Most engineering leaders who use DORA and DevEx are not misreading the frameworks out of carelessness. They are misreading them because the frameworks measure visible outputs, and visible outputs are easy to act on. What sits underneath those outputs is harder to see and harder to talk about.

That gap between what the metrics show and what is actually happening in the system is where most measurement conversations go wrong.

What DORA Is Showing You

Delivery patterns, not causes

DORA metrics describe how a delivery system behaves. Deployment frequency, lead time, change failure rate, time to restore. Together they give a picture of throughput, reliability, and recovery speed.

What they do not show is why the system behaves that way. Two teams can have identical DORA profiles for entirely different reasons. One team deploys frequently because its codebase is well-structured, ownership is clear, and testing is fast. Another deploys frequently because everything is behind feature flags and nothing activates without a separate process. The metric looks the same. The system health is not.

This is the interpretation problem. DORA tells you the pattern. It does not tell you what is generating it. Long lead times could mean an approval bottleneck, an understaffed review process, deep cross-team dependencies, or a codebase where every change touches shared infrastructure. Acting on the metric without understanding which of these is driving it tends to produce improvements that are real on paper and marginal in practice.

Where system constraints actually live

In most engineering organizations, the constraints that limit DORA performance are not inside individual teams. They are between them. Cross-service dependencies that require coordination before anything ships. Shared infrastructure owned by a platform team that becomes a bottleneck as other teams scale. Ownership boundaries that are unclear enough that every non-trivial change requires a conversation about who is responsible.

These coordination costs rarely surface in DORA data directly. They show up as lead time that is longer than it should be, or change failure rates that stay elevated despite improvements to testing. The metric registers the symptom. The cause is in how the system is structured.

What DevEx Is Showing You

Perception, not ground truth

DevEx captures how engineers experience their work across three dimensions: flow state, feedback loops, and cognitive load. Unlike DORA, it comes from surveys rather than system instrumentation. That distinction matters more than it might appear.

Survey data reflects perception, and perception is shaped by context that has nothing to do with engineering conditions. A team that just went through an organizational change, lost a key person, or is carrying a difficult incident will report lower DevEx scores regardless of whether tooling or processes changed. Acting on that signal as a tooling problem leads to the wrong intervention.

Where DevEx becomes genuinely useful is when it surfaces cognitive load that DORA cannot see. A team with strong deployment frequency can still be operating in a state where engineers are constantly context-switching between owned services and dependencies they do not fully understand, working in systems where the mental model required to make a safe change is enormous. That load does not show up in delivery metrics until it becomes a reliability problem. DevEx catches it earlier.

The coordination overhead DevEx reveals

High cognitive load in DevEx data often traces back to the same structural issues that affect DORA. Unclear ownership means engineers spend time figuring out who to talk to before they can move. Poorly defined boundaries between services mean that understanding the impact of a change requires context that lives in someone else's head. These are not individual productivity problems. They are system design problems that happen to show up in experience data.

Why Metrics Move Without the System Improving

It is common to see DORA metrics improve over a quarter while the underlying delivery environment stays difficult or gets harder. This happens because the metrics are sensitive to certain changes that are easy to make without addressing root causes.

Deployment frequency increases when deployments get smaller. Smaller deployments are generally good, but they also happen when scope gets cut in ways that defer rather than resolve complexity. Lead time improves when manual steps are removed from the pipeline. Sometimes that reflects genuine automation. Sometimes it reflects removing a review step that was slow but was also catching things.

The same pattern exists in DevEx. Cognitive load scores improve when engineers feel more confident, which can reflect genuine system simplification or simply a period of stability after a difficult stretch. The score moves. The underlying system structure does not.

This is not an argument against using either framework. It is an argument for treating the metrics as signals that warrant investigation, not conclusions that warrant action. The right response to a DORA metric moving is to ask what changed and why. The right response to a DevEx dimension shifting is to ask what in the environment actually changed.

Using Both as Diagnostics

The most productive use of DORA and DevEx together is as a way of triangulating where system-level problems are located.

When lead time is long and cognitive load is high, the likely cause is structural: dependency chains that require coordination before work can move, or ownership boundaries that are unclear enough to create friction at every handoff. Improving the pipeline without addressing the structure produces limited gains.

When change failure rate is elevated and feedback loops are weak, the likely cause is in how the system surfaces information about the impact of changes. Testing that is too slow or too narrow, deployment processes that lack observability, insufficient ownership of services that are critical path for other teams.

Neither metric is a precise diagnosis. Both are useful for narrowing the space of plausible explanations and identifying which parts of the system are worth examining closely.

Closing Thought

The value of DORA and DevEx is not in the scores. It is in the questions they make it easier to ask.

Both frameworks were designed to surface patterns in complex systems, not to explain them. The explanation requires understanding the system: how work flows across ownership boundaries, where coordination overhead accumulates, which constraints are structural and which are incidental.

Engineering leaders who get the most from these metrics tend to spend less time optimizing numbers and more time understanding what the numbers are pointing toward. The score is a starting point for that inquiry, not the end of it.

What has been your experience with DORA or DevEx in practice? Have these frameworks shaped how engineering work gets measured where you are? Share in the comments.