Eve library
ISIS v2 VFX Element Pack Regression Tests and Golden Datasets
Guide
Revision 1
On this page
Generated: 2026-08-02T18:33:40.548Z Checklist: MXA-0430 (ISIS2-00628) Asset
Family: vfx-element-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to
2026-10-30)
Objective#
Establish deterministic vfx-element-pack golden datasets and regression checks
that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.
Workflow Coverage#
Workflow
Regression Dataset Coverage
Regression Test Coverage
vfx-element-pack-baseline
yes
yes
vfx-element-pack-image-conditioned
yes
yes
vfx-element-pack-control-conditioned
yes
yes
vfx-element-pack-consistency-locked
yes
yes
Golden Case Coverage#
Case ID
Dataset Coverage
Test Coverage
golden-vfx-element-pack-baseline-smoke-plume
yes
yes
golden-vfx-element-pack-image-conditioned-fire-burst
yes
yes
golden-vfx-element-pack-control-conditioned-energy-arc
yes
yes
golden-vfx-element-pack-consistency-locked-hero-aura
yes
yes
regression-vfx-element-pack-quality-drift
yes
yes
regression-vfx-element-pack-package-contract-miss
yes
yes
Output Contract Coverage#
Output Class
Dataset Coverage
preview_image
yes
source_frames
yes
metadata_manifest
yes
Manifest Artifact
Dataset Coverage
baseline/generation-metadata.json
yes
baseline/provenance.json
yes
baseline/package-manifest.json
yes
baseline/vfx-layer-spec.json
yes
baseline/compositing-intent.json
yes
baseline/alpha-edge-report.json
yes
baseline/checksums.sha256
yes
image-conditioned/generation-metadata.json
yes
image-conditioned/provenance.json
yes
image-conditioned/package-manifest.json
yes
image-conditioned/vfx-layer-spec.json
yes
image-conditioned/compositing-intent.json
yes
image-conditioned/alpha-edge-report.json
yes
image-conditioned/checksums.sha256
yes
control-conditioned/generation-metadata.json
yes
control-conditioned/provenance.json
yes
control-conditioned/package-manifest.json
yes
control-conditioned/vfx-layer-spec.json
yes
control-conditioned/compositing-intent.json
yes
control-conditioned/alpha-edge-report.json
yes
control-conditioned/checksums.sha256
yes
consistency-locked/generation-metadata.json
yes
consistency-locked/provenance.json
yes
consistency-locked/package-manifest.json
yes
consistency-locked/vfx-layer-spec.json
yes
consistency-locked/compositing-intent.json
yes
consistency-locked/alpha-edge-report.json
yes
consistency-locked/checksums.sha256
yes
consistency-locked/continuity-profile-locks.json
yes
consistency-locked/continuity-manifest.json
yes
Verification Commands#
pnpm --filter @isis/generation-api exec vitest run src/routes/vfx-element-pack-regression-golden-dataset.spec.ts src/routes/vfx-element-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
Acceptance Criteria#
Golden dataset includes deterministic approved cases for baseline,
image-conditioned, control-conditioned, and consistency-locked
vfx-element-pack workflow variants.
Regression suite includes explicit drift scenarios for quality-threshold
failure and output-package contract non-compliance.
Regression execution validates typed vfx-element-pack workflow request
contracts and deterministic replay stability semantics.
Suite-level reporting exposes expectation accuracy, replay stability ratio,
quality-gate acceptance ratio, and output-package compliance ratio.