Eve library

ISIS v2 VFX Element Pack Quality Evaluator and Acceptance Gate

Guide

Revision 1

On this page

Generated: 2026-08-02T18:33:40.462Z Checklist: MXA-0429 (ISIS2-00627) Asset Family: vfx-element-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Deliver deterministic vfx-element-pack quality evaluation using element silhouette IoU, temporal flicker rate, motion-vector drift, and alpha-edge halo metrics with threshold-based acceptance gating in workflow execution APIs and auditable diagnostics.

Workflow Coverage#

Workflow Quality Utils Coverage Jobs Strategy Coverage Workflow Surface Coverage
vfx-element-pack-baseline yes yes no
vfx-element-pack-image-conditioned yes yes no
vfx-element-pack-control-conditioned yes yes yes
vfx-element-pack-consistency-locked yes yes yes

Quality Gate Environment Coverage#

Environment Key Quality Utils Jobs Strategy
ISIS_VFX_ELEMENT_PACK_QUALITY_GATE_ENABLED yes yes
ISIS_VFX_ELEMENT_PACK_MIN_QUALITY_SCORE yes yes
ISIS_VFX_ELEMENT_PACK_QUALITY_GATE_RETRY_AFTER_SECONDS yes yes
ISIS_VFX_ELEMENT_PACK_ELEMENT_SILHOUETTE_IOU_MIN yes yes
ISIS_VFX_ELEMENT_PACK_TEMPORAL_FLICKER_RATE_MAX yes yes
ISIS_VFX_ELEMENT_PACK_MOTION_VECTOR_DRIFT_MAX yes yes
ISIS_VFX_ELEMENT_PACK_ALPHA_EDGE_HALO_RATE_MAX yes yes

Verification Commands#

  • pnpm --filter @isis/generation-api exec vitest run src/routes/vfx-element-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • vfx-element-pack workflow variants evaluate silhouette continuity, temporal flicker, motion-vector drift, and alpha-edge integrity metrics deterministically.
  • Quality threshold violations enforce hard acceptance-gate rejection before dispatch with explicit response code and retry metadata.
  • Workflow run responses and metadata persist quality score and gate-status diagnostics for operator visibility and downstream auditing.
  • Provider compatibility diagnostics expose vfx-element-pack quality-gate policy metadata and environment-key governance coverage.