Eve library
ISIS v2 Cinematic Shot Sequence Regression Tests and Golden Datasets
Guide
Revision 1
On this page
Generated: 2026-08-02T19:12:19.237Z Checklist: MXA-0484 (ISIS2-00682) Asset
Family: cinematic-shot-sequence Phase: Phase 4 | Milestone: M3 Launch
(2026-07-27 to 2026-10-30)
Objective#
Establish deterministic cinematic-shot-sequence golden datasets and regression
checks that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.
Workflow Coverage#
Workflow
Regression Dataset Coverage
Regression Test Coverage
cinematic-shot-sequence-baseline
yes
yes
cinematic-shot-sequence-image-conditioned
yes
yes
cinematic-shot-sequence-control-conditioned
yes
yes
cinematic-shot-sequence-consistency-locked
yes
yes
Golden Case Coverage#
Case ID
Dataset Coverage
Test Coverage
golden-cinematic-shot-sequence-baseline-corridor-breach
yes
yes
golden-cinematic-shot-sequence-image-conditioned-terminal-standoff
yes
yes
golden-cinematic-shot-sequence-control-conditioned-rooftop-chase
yes
yes
golden-cinematic-shot-sequence-consistency-locked-alley-pursuit
yes
yes
regression-cinematic-shot-sequence-quality-drift
yes
yes
regression-cinematic-shot-sequence-package-contract-miss
yes
yes
Output Contract Coverage#
Output Class
Dataset Coverage
video_master
yes
source_frames
yes
metadata_manifest
yes
Manifest Artifact
Dataset Coverage
baseline/generation-metadata.json
yes
baseline/provenance.json
yes
baseline/package-manifest.json
yes
baseline/cinematic-shot-plan.json
yes
baseline/temporal-continuity-map.json
yes
baseline/camera-intent-map.json
yes
baseline/checksums.sha256
yes
image-conditioned/generation-metadata.json
yes
image-conditioned/provenance.json
yes
image-conditioned/package-manifest.json
yes
image-conditioned/cinematic-shot-plan.json
yes
image-conditioned/temporal-continuity-map.json
yes
image-conditioned/camera-intent-map.json
yes
image-conditioned/checksums.sha256
yes
control-conditioned/generation-metadata.json
yes
control-conditioned/provenance.json
yes
control-conditioned/package-manifest.json
yes
control-conditioned/cinematic-shot-plan.json
yes
control-conditioned/temporal-continuity-map.json
yes
control-conditioned/camera-intent-map.json
yes
control-conditioned/checksums.sha256
yes
consistency-locked/generation-metadata.json
yes
consistency-locked/provenance.json
yes
consistency-locked/package-manifest.json
yes
consistency-locked/cinematic-shot-plan.json
yes
consistency-locked/temporal-continuity-map.json
yes
consistency-locked/camera-intent-map.json
yes
consistency-locked/checksums.sha256
yes
consistency-locked/continuity-profile-locks.json
yes
consistency-locked/continuity-manifest.json
yes
Verification Commands#
pnpm --filter @isis/generation-api exec vitest run src/routes/cinematic-shot-sequence-regression-golden-dataset.spec.ts src/routes/cinematic-shot-sequence-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
Acceptance Criteria#
Golden dataset includes deterministic approved cases for baseline,
image-conditioned, control-conditioned, and consistency-locked
cinematic-shot-sequence workflow variants.
Regression suite includes explicit drift scenarios for quality-threshold
failure and output-package contract non-compliance.
Regression execution validates typed cinematic-shot-sequence workflow request
contracts and deterministic replay stability semantics.
Suite-level reporting exposes expectation accuracy, replay stability ratio,
quality-gate acceptance ratio, and output-package compliance ratio.