Use case Q09Test designMedium

Coverage gap & traceability check

The problem

Nobody can quickly answer: 'Which acceptance criteria have no tests?'

Workflow

  1. Requirementsstories + AC
  2. Test casesrepository
  3. Embed & matchAC ↔ cases
  4. LLM verifyreally covered?
  5. Gap reportuntested AC

Real-world example

Release 4.2 has 120 acceptance criteria. Matching finds 9 with no or weak tests, including 'Refund must be blocked after 30 days' — only the happy path was tested.

Starter prompt

For each acceptance criterion, decide if the linked test cases fully cover it, partially cover it,
or don't cover it. Explain partial coverage in one line. Return CSV: ac_id, status, reason.

Tools

Jira/Xray/TestRail export, embeddings, LLM-as-judge

Human check

Spot-check 'covered' labels — semantic match is not proof of coverage.

Measure success

% AC with verified coverage; gaps closed before release.

Concepts behind it