# ISIS v2 Animatic Shot Set Regression Tests and Golden Datasets

Generated: 2026-03-02T19:47:54.982Z Checklist: `MXA-0466` (ISIS2-00664) Asset
Family: `animatic-shot-set` Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to
2026-10-30)

## Objective

Establish deterministic animatic-shot-set golden datasets and regression checks
that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.

## Workflow Coverage

| Workflow                              | Regression Dataset Coverage | Regression Test Coverage |
| ------------------------------------- | --------------------------- | ------------------------ |
| animatic-shot-set-baseline            | yes                         | yes                      |
| animatic-shot-set-image-conditioned   | yes                         | yes                      |
| animatic-shot-set-control-conditioned | yes                         | yes                      |
| animatic-shot-set-consistency-locked  | yes                         | yes                      |

## Golden Case Coverage

| Case ID                                                      | Dataset Coverage | Test Coverage |
| ------------------------------------------------------------ | ---------------- | ------------- |
| golden-animatic-shot-set-baseline-corridor-breach            | yes              | yes           |
| golden-animatic-shot-set-image-conditioned-terminal-standoff | yes              | yes           |
| golden-animatic-shot-set-control-conditioned-rooftop-chase   | yes              | yes           |
| golden-animatic-shot-set-consistency-locked-alley-pursuit    | yes              | yes           |
| regression-animatic-shot-set-quality-drift                   | yes              | yes           |
| regression-animatic-shot-set-package-contract-miss           | yes              | yes           |

## Output Contract Coverage

| Output Class      | Dataset Coverage |
| ----------------- | ---------------- |
| preview_image     | yes              |
| source_frames     | yes              |
| metadata_manifest | yes              |

| Manifest Artifact                                | Dataset Coverage |
| ------------------------------------------------ | ---------------- |
| baseline/generation-metadata.json                | yes              |
| baseline/provenance.json                         | yes              |
| baseline/package-manifest.json                   | yes              |
| baseline/animatic-layout-spec.json               | yes              |
| baseline/shot-continuity-notes.json              | yes              |
| baseline/camera-intent-map.json                  | yes              |
| baseline/checksums.sha256                        | yes              |
| image-conditioned/generation-metadata.json       | yes              |
| image-conditioned/provenance.json                | yes              |
| image-conditioned/package-manifest.json          | yes              |
| image-conditioned/animatic-layout-spec.json      | yes              |
| image-conditioned/shot-continuity-notes.json     | yes              |
| image-conditioned/camera-intent-map.json         | yes              |
| image-conditioned/checksums.sha256               | yes              |
| control-conditioned/generation-metadata.json     | yes              |
| control-conditioned/provenance.json              | yes              |
| control-conditioned/package-manifest.json        | yes              |
| control-conditioned/animatic-layout-spec.json    | yes              |
| control-conditioned/shot-continuity-notes.json   | yes              |
| control-conditioned/camera-intent-map.json       | yes              |
| control-conditioned/checksums.sha256             | yes              |
| consistency-locked/generation-metadata.json      | yes              |
| consistency-locked/provenance.json               | yes              |
| consistency-locked/package-manifest.json         | yes              |
| consistency-locked/animatic-layout-spec.json     | yes              |
| consistency-locked/shot-continuity-notes.json    | yes              |
| consistency-locked/camera-intent-map.json        | yes              |
| consistency-locked/checksums.sha256              | yes              |
| consistency-locked/continuity-profile-locks.json | yes              |
| consistency-locked/continuity-manifest.json      | yes              |

## Verification Commands

- `pnpm --filter @isis/generation-api exec vitest run src/routes/animatic-shot-set-regression-golden-dataset.spec.ts src/routes/animatic-shot-set-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts`

## Acceptance Criteria

- Golden dataset includes deterministic approved cases for baseline,
  image-conditioned, control-conditioned, and consistency-locked
  animatic-shot-set workflow variants.
- Regression suite includes explicit drift scenarios for quality-threshold
  failure and output-package contract non-compliance.
- Regression execution validates typed animatic-shot-set workflow request
  contracts and deterministic replay stability semantics.
- Suite-level reporting exposes expectation accuracy, replay stability ratio,
  quality-gate acceptance ratio, and output-package compliance ratio.
