Eve library

ISIS v2 NPC Crowd Variation Pack Canonical Requirements Brief

Guide

Revision 1

On this page

Generated: 2026-08-02T17:39:31.157Z Checklist: MXA-0091 (ISIS2-00289) Asset Family: npc-crowd-variation-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Define a canonical implementation contract for npc-crowd-variation-pack so workflow design, contract exposure, operational rollout, and quality certification execute with measurable, release-gated criteria.

Scope#

In Scope#

  • Workflow family requirements spanning baseline, conditioned, and consistency-locked npc-crowd variation variants.
  • Control, consistency, output package, and surface parity requirements.
  • Success metrics and explicit failure criteria tied to Matrix A delivery tickets.

Out of Scope#

  • Implementation details for non-character asset families.
  • Provider-specific low-level node wiring beyond declared dependency/control contracts.

Baseline Assessment#

  • Related baseline workflow count: 4
  • Missing required controls in related baseline: ipadapter-style
  • Current control-mode pass rate (global baseline): 81.58%
  • Current required control quality average (selected controls): 0.983
Workflow ID Asset Family Output Profile Controls
animatediff-controlnet film-previs-blocking-reel video-master-profile camera-lock, camera-path-guide, color-script-lock, controlnet-canny, controlnet-depth, controlnet-lineart, controlnet-normal, controlnet-pose, controlnet-scribble, controlnet-segmentation, controlnet-softedge, depth-constraint, identity-adapter, identity-lock, keyframe-anchor-lock, latent-reuse, model-lock, motion-vector-lock, openpose-sequence, palette-lock, pose-constraint, prompt-template-lock, reference-ensemble, sampler-scheduler-lock, scene-lock, seed-lock, style-anchor, style-lock, temporal-lock, wardrobe-lock
base-avatar anim-character-turnaround-pack image-single-profile camera-lock, depth-constraint, identity-adapter, identity-lock, ipadapter-face, latent-reuse, model-lock, palette-lock, pose-constraint, prompt-template-lock, reference-ensemble, sampler-scheduler-lock, scene-lock, seed-lock, style-anchor, style-lock, temporal-lock, wardrobe-lock
hunyuan3d-asset game-character-game-ready-bundle game-ready-3d-profile model-lock, seed-lock, reference-ensemble, camera-lock
stable-zero123 game-character-game-ready-bundle game-ready-3d-profile camera-lock, controlnet-depth, controlnet-normal, depth-constraint, identity-adapter, latent-reuse, lens-profile-lock, model-lock, palette-lock, pose-constraint, reference-ensemble, sampler-scheduler-lock, scene-lock, seed-lock, style-anchor, temporal-lock, wardrobe-lock

Canonical Requirements#

Output Package Contract Baseline#

Output Class Required Package Classes
preview_image preview, metadata, manifest
source_frames source-frames, metadata, manifest
metadata_manifest metadata, manifest

Required Controls#

Control Category Coverage Baseline Quality Baseline
seed-lock determinism 4 workflows 1.000
sampler-scheduler-lock determinism 3 workflows 1.000
model-lock determinism 4 workflows 1.000
prompt-template-lock determinism 2 workflows 1.000
style-lock style-and-identity 2 workflows 1.000
identity-lock style-and-identity 2 workflows 0.963
color-script-lock style-and-identity 1 workflows 1.000
ipadapter-style reference-guidance 0 workflows 0.900
controlnet-pose spatial-guidance 1 workflows 1.000
controlnet-depth spatial-guidance 2 workflows 1.000
controlnet-segmentation spatial-guidance 1 workflows 1.000
controlnet-normal spatial-guidance 2 workflows 1.000
controlnet-canny spatial-guidance 1 workflows 0.950
controlnet-lineart spatial-guidance 1 workflows 0.950

Functional Requirements#

ID Checklist Requirement
F-000 MXA-0091 Publish a canonical, machine-readable requirements brief for npc-crowd-variation-pack that defines scope, constraints, success metrics, and failure criteria.
F-001 MXA-0092 Design baseline workflow graph for npc-crowd-variation-pack with deterministic defaults.
F-002 MXA-0093 Design image-conditioned variant workflow for npc-crowd-variation-pack.
F-003 MXA-0094 Design control-conditioned variant workflow for npc-crowd-variation-pack (pose/depth/segmentation where applicable).
F-004 MXA-0095 Design consistency-locked variant workflow for npc-crowd-variation-pack with continuity profile support.
F-005 MXA-0096 Define model/node dependency manifest for npc-crowd-variation-pack workflows.
F-006 MXA-0097 Define output package contract for npc-crowd-variation-pack including file naming and metadata manifest.
F-007 MXA-0098 Add workflow templates and presets for npc-crowd-variation-pack production tiers (draft/final/hero).
F-008 MXA-0099 Expose npc-crowd-variation-pack workflows via generation API with typed request contracts.
F-009 MXA-0100 Expose npc-crowd-variation-pack workflows via SDK with end-to-end examples.
F-010 MXA-0101 Expose npc-crowd-variation-pack workflows in web UI with ergonomic form controls and validation.
F-011 MXA-0102 Implement side-by-side comparison tools for npc-crowd-variation-pack outputs.
F-012 MXA-0103 Map npc-crowd-variation-pack workflows to RunPod endpoint classes and sizing policies.
F-013 MXA-0104 Add npc-crowd-variation-pack cost estimation and budget guardrails.
F-014 MXA-0105 Add npc-crowd-variation-pack quality evaluator and threshold-based acceptance gate.
F-015 MXA-0106 Add npc-crowd-variation-pack regression tests and golden datasets.
F-016 MXA-0107 Add npc-crowd-variation-pack external integration recipe for downstream tools/systems.
F-017 MXA-0108 Publish npc-crowd-variation-pack operator and creator documentation with troubleshooting.

Non-Functional Requirements#

ID Title Verification
NF-001 Deterministic replay reliability Replay the approved golden set over two independent runs and compute reproducibility pass ratio.
NF-002 Control coverage completeness Run contract and UX coverage checks against control IDs: seed-lock, style-lock, identity-lock, color-script-lock, ipadapter-style, controlnet-pose, controlnet-depth, controlnet-segmentation, controlnet-normal, controlnet-canny, controlnet-lineart.
NF-003 Output package integrity Validate output package contract and checksum manifest presence for each golden output.
NF-004 Operational budget guardrails Evaluate p95 runtime/cost telemetry against policy thresholds and enforce rejection when guardrails fail.
NF-005 External integration readiness Pass external integration cookbook examples and operator runbook smoke checks.

Success Metrics#

Metric Target Baseline Linked Checklist IDs
SM-001 >= 4 certified workflows (baseline, image-conditioned, control-conditioned, consistency-locked). 0 workflows currently mapped to npc-crowd-variation-pack. MXA-0092, MXA-0093, MXA-0094, MXA-0095, MXA-0106
SM-002 17/17 downstream tickets DONE by milestone end date. 17/17 downstream tickets are DONE at report generation. MXA-0092, MXA-0093, MXA-0094, MXA-0095, MXA-0096, MXA-0097, MXA-0098, MXA-0099, MXA-0100, MXA-0101, MXA-0102, MXA-0103, MXA-0104, MXA-0105, MXA-0106, MXA-0107, MXA-0108
SM-003 14/14 required controls implemented and exposed. 13/14 controls currently evidenced in related baseline workflows. MXA-0094, MXA-0099, MXA-0100, MXA-0101
SM-004 Average required-control quality score >= 0.75. Current benchmark baseline: 0.983. MXA-0105, MXA-0106
SM-005 face_embedding_cosine_similarity >= 0.82 and facial_landmark_drift_px <= 12. Not yet measured for npc-crowd-variation-pack baseline (family not implemented). MXA-0095, MXA-0105, MXA-0106
SM-006 garment_attribute_match_ratio >= 0.86 and wardrobe_palette_delta_e <= 7.5. Not yet measured for npc-crowd-variation-pack baseline (family not implemented). MXA-0095, MXA-0105, MXA-0106
SM-007 100% of outputs include package classes required by preview_image, source_frames, and metadata_manifest mappings. No dedicated npc-crowd-variation-pack output package contract is currently published. MXA-0097, MXA-0106
SM-008 Typed request/response support and user-facing controls available across generation API, SDK, and web UI with zero schema drift. npc-crowd-variation-pack family not yet exposed on API/SDK/UI surfaces. MXA-0099, MXA-0100, MXA-0101

Failure Criteria#

Criterion Trigger Severity Required Response
FC-001 Any of baseline, image-conditioned, control-conditioned, or consistency-locked variants is absent or uncertified. high Block promotion and complete missing variant tickets before reopening certification.
FC-002 Any required control ID is missing from workflow metadata or is not exposed consistently in API/SDK/UI. high Fail contract parity checks and block release until missing control contracts and UI exposure are restored.
FC-003 Identity, wardrobe, or color continuity metrics fail taxonomy thresholds across approved golden datasets. high Reject quality gate, retune workflows/models, and rerun regression benchmark until thresholds pass.
FC-004 Generated outputs are missing required package classes or manifest/checksum artifacts. high Fail output package validation and block external integrations until packaging contract is restored.
FC-005 Cost estimation or runtime sizing exceeds approved guardrails without explicit override policy. medium Apply hard-fail guardrail behavior and reclassify endpoint sizing before allowing additional runs.
FC-006 Golden dataset or regression suite detects perceptual drift above accepted threshold. high Mark build as non-releasable, investigate drift root cause, and refresh certification evidence only after pass.

Downstream Delivery Map#

Ticket Checklist Status Title
ISIS2-00290 MXA-0092 DONE Design baseline workflow graph for npc-crowd-variation-pack with deterministic defaults.
ISIS2-00291 MXA-0093 DONE Design image-conditioned variant workflow for npc-crowd-variation-pack.
ISIS2-00292 MXA-0094 DONE Design control-conditioned variant workflow for npc-crowd-variation-pack (pose/depth/segmentation where applicable).
ISIS2-00293 MXA-0095 DONE Design consistency-locked variant workflow for npc-crowd-variation-pack with continuity profile support.
ISIS2-00294 MXA-0096 DONE Define model/node dependency manifest for npc-crowd-variation-pack workflows.
ISIS2-00295 MXA-0097 DONE Define output package contract for npc-crowd-variation-pack including file naming and metadata manifest.
ISIS2-00296 MXA-0098 DONE Add workflow templates and presets for npc-crowd-variation-pack production tiers (draft/final/hero).
ISIS2-00297 MXA-0099 DONE Expose npc-crowd-variation-pack workflows via generation API with typed request contracts.
ISIS2-00298 MXA-0100 DONE Expose npc-crowd-variation-pack workflows via SDK with end-to-end examples.
ISIS2-00299 MXA-0101 DONE Expose npc-crowd-variation-pack workflows in web UI with ergonomic form controls and validation.
ISIS2-00300 MXA-0102 DONE Implement side-by-side comparison tools for npc-crowd-variation-pack outputs.
ISIS2-00301 MXA-0103 DONE Map npc-crowd-variation-pack workflows to RunPod endpoint classes and sizing policies.
ISIS2-00302 MXA-0104 DONE Add npc-crowd-variation-pack cost estimation and budget guardrails.
ISIS2-00303 MXA-0105 DONE Add npc-crowd-variation-pack quality evaluator and threshold-based acceptance gate.
ISIS2-00304 MXA-0106 DONE Add npc-crowd-variation-pack regression tests and golden datasets.
ISIS2-00305 MXA-0107 DONE Add npc-crowd-variation-pack external integration recipe for downstream tools/systems.
ISIS2-00306 MXA-0108 DONE Publish npc-crowd-variation-pack operator and creator documentation with troubleshooting.

Traceability#

  • Checklist item: MXA-0091
  • Ticket key: ISIS2-00289
  • Source references:
    • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ASSET_TAXONOMY.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CONTROL_TAXONOMY.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CONSISTENCY_TAXONOMY.json
    • docs/domains/isis/remediation-v2/ISIS_V2_OUTPUT_PACKAGE_TAXONOMY.json
    • libs/isis/workflows/src/metadata/workflow-taxonomy-registry.json
    • docs/domains/isis/remediation-v2/ISIS_V2_BENCHMARK_DASHBOARD.json
    • ISIS_TODOS_2.md