# ISIS v2 Storyboard Frame Set Regression Tests and Golden Datasets

Generated: 2026-08-02T19:12:17.052Z Checklist: `MXA-0448` (ISIS2-00646) Asset
Family: `storyboard-frame-set` Phase: Phase 4 | Milestone: M3 Launch (2026-07-27
to 2026-10-30)

## Objective

Establish deterministic storyboard-frame-set golden datasets and regression
checks that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.

## Workflow Coverage

| Workflow                                 | Regression Dataset Coverage | Regression Test Coverage |
| ---------------------------------------- | --------------------------- | ------------------------ |
| storyboard-frame-set-baseline            | yes                         | yes                      |
| storyboard-frame-set-image-conditioned   | yes                         | yes                      |
| storyboard-frame-set-control-conditioned | yes                         | yes                      |
| storyboard-frame-set-consistency-locked  | yes                         | yes                      |

## Golden Case Coverage

| Case ID                                                         | Dataset Coverage | Test Coverage |
| --------------------------------------------------------------- | ---------------- | ------------- |
| golden-storyboard-frame-set-baseline-corridor-breach            | yes              | yes           |
| golden-storyboard-frame-set-image-conditioned-terminal-standoff | yes              | yes           |
| golden-storyboard-frame-set-control-conditioned-rooftop-chase   | yes              | yes           |
| golden-storyboard-frame-set-consistency-locked-alley-pursuit    | yes              | yes           |
| regression-storyboard-frame-set-quality-drift                   | yes              | yes           |
| regression-storyboard-frame-set-package-contract-miss           | yes              | yes           |

## Output Contract Coverage

| Output Class      | Dataset Coverage |
| ----------------- | ---------------- |
| preview_image     | yes              |
| source_frames     | yes              |
| metadata_manifest | yes              |

| Manifest Artifact                                | Dataset Coverage |
| ------------------------------------------------ | ---------------- |
| baseline/generation-metadata.json                | yes              |
| baseline/provenance.json                         | yes              |
| baseline/package-manifest.json                   | yes              |
| baseline/storyboard-layout-spec.json             | yes              |
| baseline/panel-continuity-notes.json             | yes              |
| baseline/camera-intent-map.json                  | yes              |
| baseline/checksums.sha256                        | yes              |
| image-conditioned/generation-metadata.json       | yes              |
| image-conditioned/provenance.json                | yes              |
| image-conditioned/package-manifest.json          | yes              |
| image-conditioned/storyboard-layout-spec.json    | yes              |
| image-conditioned/panel-continuity-notes.json    | yes              |
| image-conditioned/camera-intent-map.json         | yes              |
| image-conditioned/checksums.sha256               | yes              |
| control-conditioned/generation-metadata.json     | yes              |
| control-conditioned/provenance.json              | yes              |
| control-conditioned/package-manifest.json        | yes              |
| control-conditioned/storyboard-layout-spec.json  | yes              |
| control-conditioned/panel-continuity-notes.json  | yes              |
| control-conditioned/camera-intent-map.json       | yes              |
| control-conditioned/checksums.sha256             | yes              |
| consistency-locked/generation-metadata.json      | yes              |
| consistency-locked/provenance.json               | yes              |
| consistency-locked/package-manifest.json         | yes              |
| consistency-locked/storyboard-layout-spec.json   | yes              |
| consistency-locked/panel-continuity-notes.json   | yes              |
| consistency-locked/camera-intent-map.json        | yes              |
| consistency-locked/checksums.sha256              | yes              |
| consistency-locked/continuity-profile-locks.json | yes              |
| consistency-locked/continuity-manifest.json      | yes              |

## Verification Commands

- `pnpm --filter @isis/generation-api exec vitest run src/routes/storyboard-frame-set-regression-golden-dataset.spec.ts src/routes/storyboard-frame-set-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts`

## Acceptance Criteria

- Golden dataset includes deterministic approved cases for baseline,
  image-conditioned, control-conditioned, and consistency-locked
  storyboard-frame-set workflow variants.
- Regression suite includes explicit drift scenarios for quality-threshold
  failure and output-package contract non-compliance.
- Regression execution validates typed storyboard-frame-set workflow request
  contracts and deterministic replay stability semantics.
- Suite-level reporting exposes expectation accuracy, replay stability ratio,
  quality-gate acceptance ratio, and output-package compliance ratio.
