Eve library
ISIS v2 Animatic Shot Set Regression Tests and Golden Datasets
Guide
Revision 1
On this page
Generated: 2026-03-02T19:47:54.982Z Checklist: MXA-0466 (ISIS2-00664) Asset
Family: animatic-shot-set Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to
2026-10-30)
Objective#
Establish deterministic animatic-shot-set golden datasets and regression checks
that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.
Workflow Coverage#
Workflow
Regression Dataset Coverage
Regression Test Coverage
animatic-shot-set-baseline
yes
yes
animatic-shot-set-image-conditioned
yes
yes
animatic-shot-set-control-conditioned
yes
yes
animatic-shot-set-consistency-locked
yes
yes
Golden Case Coverage#
Case ID
Dataset Coverage
Test Coverage
golden-animatic-shot-set-baseline-corridor-breach
yes
yes
golden-animatic-shot-set-image-conditioned-terminal-standoff
yes
yes
golden-animatic-shot-set-control-conditioned-rooftop-chase
yes
yes
golden-animatic-shot-set-consistency-locked-alley-pursuit
yes
yes
regression-animatic-shot-set-quality-drift
yes
yes
regression-animatic-shot-set-package-contract-miss
yes
yes
Output Contract Coverage#
Output Class
Dataset Coverage
preview_image
yes
source_frames
yes
metadata_manifest
yes
Manifest Artifact
Dataset Coverage
baseline/generation-metadata.json
yes
baseline/provenance.json
yes
baseline/package-manifest.json
yes
baseline/animatic-layout-spec.json
yes
baseline/shot-continuity-notes.json
yes
baseline/camera-intent-map.json
yes
baseline/checksums.sha256
yes
image-conditioned/generation-metadata.json
yes
image-conditioned/provenance.json
yes
image-conditioned/package-manifest.json
yes
image-conditioned/animatic-layout-spec.json
yes
image-conditioned/shot-continuity-notes.json
yes
image-conditioned/camera-intent-map.json
yes
image-conditioned/checksums.sha256
yes
control-conditioned/generation-metadata.json
yes
control-conditioned/provenance.json
yes
control-conditioned/package-manifest.json
yes
control-conditioned/animatic-layout-spec.json
yes
control-conditioned/shot-continuity-notes.json
yes
control-conditioned/camera-intent-map.json
yes
control-conditioned/checksums.sha256
yes
consistency-locked/generation-metadata.json
yes
consistency-locked/provenance.json
yes
consistency-locked/package-manifest.json
yes
consistency-locked/animatic-layout-spec.json
yes
consistency-locked/shot-continuity-notes.json
yes
consistency-locked/camera-intent-map.json
yes
consistency-locked/checksums.sha256
yes
consistency-locked/continuity-profile-locks.json
yes
consistency-locked/continuity-manifest.json
yes
Verification Commands#
pnpm --filter @isis/generation-api exec vitest run src/routes/animatic-shot-set-regression-golden-dataset.spec.ts src/routes/animatic-shot-set-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
Acceptance Criteria#
Golden dataset includes deterministic approved cases for baseline,
image-conditioned, control-conditioned, and consistency-locked
animatic-shot-set workflow variants.
Regression suite includes explicit drift scenarios for quality-threshold
failure and output-package contract non-compliance.
Regression execution validates typed animatic-shot-set workflow request
contracts and deterministic replay stability semantics.
Suite-level reporting exposes expectation accuracy, replay stability ratio,
quality-gate acceptance ratio, and output-package compliance ratio.