Generated: 2026-08-02T12:38:46.120Z Checklist: MXA-0232 (ISIS2-00430) Asset
Family: prop-pack-general Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to
2026-10-30)
Objective#
Establish deterministic prop-pack-general golden datasets and regression checks that validate typed workflow contracts, quality-gate stability, and output-package contract compliance across all workflow variants.
Workflow Coverage#
| Workflow | Regression Dataset Coverage | Regression Test Coverage |
|---|---|---|
prop-pack-general-baseline |
yes | yes |
prop-pack-general-image-conditioned |
yes | yes |
prop-pack-general-control-conditioned |
yes | yes |
prop-pack-general-consistency-locked |
yes | yes |
Golden/Regression Case Coverage#
| Case ID | Dataset Coverage | Test Coverage |
|---|---|---|
golden-prop-pack-general-baseline-fortified-citadel |
yes | yes |
golden-prop-pack-general-image-conditioned-orbital-habitat |
yes | yes |
golden-prop-pack-general-control-conditioned-industrial-megaforge |
yes | yes |
golden-prop-pack-general-consistency-locked-sequence |
yes | yes |
regression-prop-pack-general-quality-drift |
yes | yes |
regression-prop-pack-general-package-contract-miss |
yes | yes |
Verification Commands#
pnpm --filter @isis/generation-api exec vitest run src/routes/prop-pack-general-regression-golden-dataset.spec.ts src/routes/prop-pack-general-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
Acceptance Criteria#
- Golden dataset includes deterministic approved cases for baseline, image-conditioned, control-conditioned, and consistency-locked workflow variants.
- Regression suite includes explicit drift scenarios for quality-threshold failure and output-package contract non-compliance.
- Regression execution validates typed workflow request contracts and deterministic replay stability semantics.
- Suite-level reporting exposes expectation accuracy, replay stability ratio, quality-gate acceptance ratio, and output-package compliance ratio.
Traceability#
- Checklist item:
MXA-0232 - Ticket key:
ISIS2-00430 - Upstream dependency:
MXA-0231