Since 1994

How much testing

is enough?

The Cost-of-Quality curve answers the board-level question. · Rex Black, Inc.

Most test budgets are argued

in absolute terms.


"We need more testers." "We already spend too much on QA."
Neither argument wins without a frame.


Cost of Quality is the frame.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
What this is about

In plain English.


Every dollar you spend preventing bugs reduces the dollars you spend paying for bugs. Up to a point.


Past that point, prevention gets disproportionately expensive and returns shrink. The total cost of quality curve is U-shaped, and the bottom of the U is what an enterprise quality function should target.


This piece gives you:

  • The static model, find the economic optimum.
  • The dynamic model, track what it actually costs, month by month.
  • Calibration rules, adapt the model to your cost structure.
REX BLACK, INC. · COST OF QUALITY WORKSHEET
The frame

Two costs. One sum.

Cost of Conformance, CoC

What you pay to prevent and detect defects. Test labor, tooling, environments, reviews, training.

Rises as DDP rises.

Cost of Nonconformance, CoN

What you pay because of defects. Rework, support, warranty, lost CLV, regulatory fines.

Falls as DDP rises.


CoQ = CoC + CoN. The function to minimize. That's the whole framework.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
The static model

U-shaped.

Every time.


Sweep DDP from 0 to 1.
The sum of CoC and CoN bottoms out, then explodes.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Static · reading the curve

Three zones.

Under-invested (DDP < 0.6)

CoN dominates. Customers find the defects. Support, rework, churn, all high. The cheapest option is more testing.

Optimum zone (DDP ≈ 0.7–0.8)

CoC and CoN cross in economic equilibrium. Total CoQ minimized. The answer to "how much testing is enough."


Over-invested (DDP > 0.85). CoC explodes. The last defects are the hardest to find, you pay exponentially more for each additional percent. For most commercial software this is value-negative.

REX BLACK, INC. · COST OF QUALITY WORKSHEET

0.7–0.8

The economic optimum band · DDP · most commercial software
REX BLACK, INC. · COST OF QUALITY WORKSHEET
Static · what moves the optimum

Three context knobs.

Safety-critical

Aerospace, medical, automotive. CoN includes human-life cost. Optimum moves to 0.95+.

Consumer SaaS

Feature velocity compounds; CoN per escape is low. Optimum moves to ~0.7.


Regulated financial services sit near 0.85 because CoN includes fines and brand damage. Know your band. Don't argue the generic curve with a CFO, argue your industry band.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
The dynamic model

The curve over program time.


Static says what the target is.
Dynamic says what it costs to hit it.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Dynamic · the shape

CoC steady. CoN decaying.


  • CoC per month, test-function budget ÷ months. Roughly flat across a program (the team shows up every month).
  • CoN per month, (defects-remaining-at-month-M × per-defect-CoN). Decays as testing removes defects from the latent population.
  • CoQ per month, their sum. Total CoQ accumulates; cumulative CoQ is the metric finance cares about.

Programs whose cumulative CoQ rises steeply after month 3 are buying less marginal quality per dollar than the model predicted. That is a signal to re-examine the test basis, not to add more testers.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Cad vs. Heroine

Two programs. Same product.

Different targets.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Worked example

Invest earlier, pay less total.

The Cad, DDP 0.46

Low-investment program. Month 0 CoC is lower. By month 6, cumulative CoQ is higher because CoN balloons.

The Heroine, DDP 0.67

Higher-investment program. Month 0 CoC is higher. By month 6, cumulative CoQ is lower because CoN is much smaller.


The shape that surprises non-practitioners: the program that spent more on testing cost less overall. The Metrics Part 4 whitepaper has the same result. Pay now or pay more later.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Calibration

Two numbers.

That's the whole bridge.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Calibrate · CoN per escaped defect

Industry range. Your prior programs.


  • Support intake + developer fix effort + support callbacks + lost productivity.
  • Typical band: $500–$10,000 per escaped defect depending on industry.
  • Safety-critical: tens of thousands to millions (one escape = lawsuit or recall).
  • AI-backed systems: adds a new CoN category, reputational cost of public hallucination, disparate-impact lawsuits, regulatory exposure.

Use the Internal / External Failure worksheet in the test budget template as the calibration path. Industry averages are sanity checks, not substitutes for your data.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Calibrate · CoC per detected defect

Test investment ÷ defects found.


  • Total test-function budget (staff + tools + env + labs + contingency) ÷ total defects found.
  • Year 1: expect higher per-defect CoC because fixed-cost investments amortize over fewer finds.
  • Year 2+: converges to industry normal (~$100–$500 per defect detected in enterprise).

This number is critical for the static model, and surprisingly few organizations compute it. Knowing this one ratio unlocks every COQ argument.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
2026 curve shifts

The U is still U-shaped.

At lower altitude.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
What has changed since 2002

Three forces. All real.

Automation

Per-test-case CoC goes down. The optimum shifts right, higher DDP is newly economical.

Observability

Production telemetry catches escapes before customers. CoN goes down. Optimum shifts left, less test needed to hit the same risk level.


AI-assisted test authoring pushes per-test-case CoC down further. But introduces a new CoN category (AI-system unsafe outputs) that needs its own DDP target. Net effect: the curve is still U-shaped, at a lower altitude for most programs than it was 10 years ago.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
How to use the worksheet

Six steps.

In order.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
How to use it · 1–3

Calibrate, then sweep.


  1. Calibrate CoN per escaped defect. Start from the Internal / External Failure worksheet. Industry ranges are a sanity check only.
  2. Calibrate CoC per detected defect. Total test-function investment ÷ total defects found.
  3. Sweep the static model. DDP from 0 to 1 in 0.1 increments. Plot all three curves (CoN, CoC, CoQ). Mark the minimum, that's your DDP target.
REX BLACK, INC. · COST OF QUALITY WORKSHEET
How to use it · 4–6

Track against the target.


  1. Set the dynamic model. CoC as steady monthly spend. CoN as defects-remaining × per-defect-CoN. Project cumulative CoQ by month.
  2. After month 2, compare actuals to projection. Within ±10% is normal. Outside that band is a signal.
  3. Compare programs in the portfolio. Higher-DDP programs have higher early CoC but lower cumulative CoQ by month 6. That's the pattern.
REX BLACK, INC. · COST OF QUALITY WORKSHEET
The takeaways

Three. That's the argument.

REX BLACK, INC. · COST OF QUALITY WORKSHEET
Takeaways · 1 of 2

The optimum is not DDP = 1.


  • CoQ is U-shaped. Both too little and too much testing are expensive.
  • Industry band matters. Commercial SaaS sits near 0.7. Regulated 0.85. Safety-critical 0.95+. Know yours.
  • The model says "enough." Without it, budgets are argued in absolute terms, and lose.
REX BLACK, INC. · COST OF QUALITY WORKSHEET
Takeaways · 2 of 2

Earlier investment. Lower total.


  • Dynamic CoQ tracks what static predicted. Divergence after month 2 is a planning signal.
  • Higher DDP target from month 0 means lower cumulative CoQ by month 6. Counterintuitive until you draw the curves.
  • Re-calibrate annually. Automation, observability, and AI are moving the curve. The 2002 optimum is not today's optimum.
REX BLACK, INC. · COST OF QUALITY WORKSHEET
Since 1994

Thank you.

Rex Black, Inc. · rexblack.com/resources/qa-library/cost-of-quality-worksheet