Eve library

ISIS v2 NPC Crowd Variation Pack Quality Evaluator and Acceptance Gate

Guide

Revision 1

On this page

Generated: 2026-08-02T17:39:31.956Z Checklist: MXA-0105 (ISIS2-00303) Asset Family: npc-crowd-variation-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Deliver deterministic npc-crowd-variation-pack quality evaluation using identity, facial-geometry, garment-match, and palette-consistency metrics, and enforce threshold-based acceptance gating in workflow execution APIs with auditable diagnostics.

Workflow Coverage#

Workflow Quality Utils Coverage Jobs Strategy Coverage Workflow Surface Coverage
npc-crowd-variation-pack-baseline yes yes no
npc-crowd-variation-pack-image-conditioned yes yes no
npc-crowd-variation-pack-control-conditioned yes yes yes
npc-crowd-variation-pack-consistency-locked yes yes yes

Quality Gate Environment Keys#

Env Key Quality Utils Coverage Jobs Strategy Coverage
ISIS_NPC_CROWD_VARIATION_PACK_QUALITY_GATE_ENABLED yes yes
ISIS_NPC_CROWD_VARIATION_PACK_MIN_QUALITY_SCORE yes yes
ISIS_NPC_CROWD_VARIATION_PACK_QUALITY_GATE_RETRY_AFTER_SECONDS yes yes
ISIS_NPC_CROWD_VARIATION_PACK_FACE_EMBEDDING_MIN yes yes
ISIS_NPC_CROWD_VARIATION_PACK_FACIAL_LANDMARK_DRIFT_MAX_PX yes yes
ISIS_NPC_CROWD_VARIATION_PACK_GARMENT_ATTRIBUTE_MATCH_MIN yes yes
ISIS_NPC_CROWD_VARIATION_PACK_WARDROBE_PALETTE_DELTA_E_MAX yes yes

Verification Commands#

  • pnpm --filter @isis/generation-api exec vitest run src/routes/npc-crowd-variation-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • NPC crowd variation pack workflow variants evaluate identity, facial-landmark drift, garment-attribute, and palette-delta quality metrics deterministically.
  • Quality threshold violations enforce hard acceptance-gate rejection before dispatch with explicit response code and retry metadata.
  • Workflow run responses and metadata persist quality score and gate-status diagnostics for operator visibility and downstream auditing.
  • Provider compatibility diagnostics expose npc-crowd-variation-pack quality-gate policy metadata and environment-key governance coverage.

Traceability#

  • Checklist item: MXA-0105
  • Ticket key: ISIS2-00303
  • Enforcement route: /api/v1/workflows/:workflowId/run
  • Error code: NPC_CROWD_VARIATION_PACK_QUALITY_GATE_FAILED