Since 1994

Five trends affecting

software testing.

What the AI era is doing to the QA profession · Rex Black, Inc.

The profession

renews every generation.


The five trends called in 2005 — all played out.


Offshore QA teams. TDD and CI. Software getting cheap and good enough. HIPAA → GDPR → EU AI Act. ISTQB as baseline credential.

This deck is the next round.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
What this is about

In plain English.


Every ~20 years, the software testing profession reshapes itself around a new set of forcing functions. If you're building skills for the last cycle, you're already late.


This talk names the five macro-forces reshaping testing right now, on a 3–5 year horizon:

  • How AI-generated code changes the test denominator.
  • Why platform engineering eats test environment management.
  • How regulation and liability turn testing evidence into a legal artifact.
  • Why the software supply chain is the largest unaudited risk most products have.
  • Why production telemetry is now the biggest quality signal.

Written for QA leaders, test managers, and senior testers planning the next 3–5 years of skill investment. Also for engineering leaders sponsoring or rebuilding a QA function.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 1 of 5

AI-generated software

&

AI-assisted testing.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 1 · AI changes the denominator

Dev velocity up. Test capacity same?


Engineering teams are shipping AI-drafted code at several multiples of historical velocity.


If test capacity doesn't scale proportionally, the bottleneck simply moves — from "not enough developers" to "not enough testers."

Threat

Volume of code outpaces human test capacity. Testing becomes the bottleneck or the blind spot.

What to learn

LLM-based test generation and critique. Agent-driven exploration. Model-eval frameworks. Prompt/evaluator testing. AI behavior regression.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 2 of 5

Platform engineering

&

ephemeral test environments.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 2 · Platforms eat environments

Test env management

is a platform discipline now.


Internal Developer Platforms absorb what used to be ad-hoc infra work. Engineers self-serve dev / test / staging through a platform layer. Infrastructure is code.


Threat

Test environment management is being absorbed by platform engineering. QA teams that don't participate get what's left over.

What to learn

Infra-as-code (Terraform / Pulumi). Ephemeral preview environments. K8s test fixtures. CI/CD pipeline design. Environment observability.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 3 of 5

Regulation.

Product liability.

AI governance.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 3 · Testing is now evidence

Test records are legal artifacts.


What began with SOX and HIPAA has compounded. GDPR. State privacy laws. EU AI Act. SEC cyber-incident disclosure. Sectoral rules — IEC 62304, ISO 26262, financial services.


For AI-enabled products, governance adds a second stack: model documentation, evaluation disclosures, bias testing, model cards, post-deployment monitoring.

Threat

Testing evidence is discoverable. A poor testing record is a legal liability, not just a quality problem.

What to learn

Requirements traceability. Audit-grade test documentation. OWASP ASVS. AI-system evaluation standards. Privacy-testing practice.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 4 of 5

The software

supply chain.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 4 · Your risk surface ≫ your code

The largest unaudited risk.


Every shipping product is now mostly open-source and third-party code — frameworks, libraries, cloud services, external APIs, model providers.


SolarWinds. Log4Shell. xz-utils. All showed what happens when that surface goes untested.

Threat

Product's risk surface is bigger than the code the team wrote. Testing scope has to expand or becomes irrelevant.

What to learn

SBOM tooling (Syft, Dependency-Track). SCA / SAST integration. API-contract testing (Pact, OpenAPI). Dependency-risk scoring. Third-party model evaluation.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 5 of 5

Continuous quality

via observability.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Trend 5 · Production is the test signal

SLOs · error budgets · RUM.


The old line — "testers test before ship, ops measures after" — does not survive modern deployment cadences.


Feature flags. Progressive rollouts. Canary deploys. Real-user monitoring. SLO / error-budget discipline. The biggest test signal in a mature organization comes from production.

Threat

Pre-production-only testing is insufficient. Production telemetry is where the real quality signal is.

What to learn

SLO design. Error-budget accounting. Synthetic monitoring. RUM. Chaos testing. Progressive delivery.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
How they compound

*Five trends,

one pipeline.*

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
The compounding effect

They don't act alone.


Trend 1 · AI-generated code raises test volume,
which forces
Trend 2 · Platform-engineered automation,

which produces
Trend 3 · Audit-ready evidence for regulators,
covering
Trend 4 · Third-party dependencies,
fed by
Trend 5 · Production telemetry.


The test-engineering role that survives the next cycle is the one that operates across all five.

The one that specializes narrowly in "write test cases against a spec" is the one that gets outsourced or AI-assisted out of the industry.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
A skills ladder

Five years.

Five trends.

One professional you.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Skills ladder

Without a career restart.


  • Year 1 — AI-assisted testing tools. Solid LLM-evals foundation.
  • Year 2 — Infra-as-code and CI/CD. Commit the test-environment model to git.
  • Year 3 — Audit-grade traceability. One compliance specialty (AI governance, medical, or financial).
  • Year 4 — Supply-chain testing. SBOM, SCA integration.
  • Year 5 — Ownership of production quality signal. SLOs, error budgets, synthetic monitoring.

Five years. Five trends. One professional you.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Takeaways

Build for the next round.

Not the last one.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Takeaways

Five to hold against.


  • Profession renews every generation. Five calls in 2005 all played out. These five will too.
  • AI changes the denominator. If dev velocity 3–10× and test capacity stays the same, the bottleneck moves — or quality drops.
  • Testing evidence is a legal artifact. Traceability is risk management, not hygiene.
  • Product isn't just your code. Supply chain is the largest unaudited surface.
  • Production is the biggest test signal. Pre-production-only testing leaves it on the floor.

Learn to sail into the wind. Disruptions create opportunities for those quick enough to seize them.

REX BLACK, INC. · FIVE TRENDS AFFECTING TESTING
Since 1994

Thank you.

Rex Black, Inc. · rexblack.com/resources/talks/five-trends-affecting-testing