Eve library

ISIS v2 Music Cue Pack Control-Conditioned Workflow Graph

Guide

Revision 1

On this page

Generated: 2026-03-03T16:23:37.890Z Checklist: MXA-0562 (ISIS2-00760) Asset Family: music-cue-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Define a control-conditioned workflow graph for music-cue-pack that maps pose/depth/segmentation/canny/lineart control modalities into cue-composition guidance signals where applicable while preserving deterministic synthesis defaults and mastered-audio output contracts.

Deterministic Defaults#

Setting Value
modelName ace_step_multilingual.safetensors
promptTemplateId music-cue-pack-control-conditioned-v1
styleProfileId music-cue-pack-control-guidance-v1
seed 2026073105
durationSeconds 20
tempoBpm 96
sampleRateHz 48000
targetLufs -14
outputFormat wav
outputChannels 2
outputBitDepth 24
controlApplicabilityMode where-applicable
controlSignalFusion weighted-sum
providerCapabilityMode required
minimumEnabledControlsPerRun 1
poseStrength 0.42
depthStrength 0.66
segmentationStrength 0.58
cannyStrength 0.52
lineartStrength 0.49
eventAlignmentMode cue-hit-priority

Input Contract#

Input Type Required Default
pose_map image no n/a
depth_map image no n/a
segmentation_map image no n/a
edge_map image no n/a
lineart_map image no n/a
use_pose_control boolean yes false
use_depth_control boolean yes true
use_segmentation_control boolean yes true
use_canny_control boolean yes true
use_lineart_control boolean yes false
pose_strength float yes 0.42
depth_strength float yes 0.66
segmentation_strength float yes 0.58
canny_strength float yes 0.52
lineart_strength float yes 0.49
control_applicability_mode enum yes "where-applicable"
control_signal_fusion enum yes "weighted-sum"
control_profile_id string yes "MUSIC_CUE_CONTROL_PROFILE_V1"
control_timeline_fps integer yes 24
event_alignment_mode enum yes "cue-hit-priority"
cue_id string yes "MUSIC_CUE_M3_CONTROL_CONDITIONED_01"
prompt string yes "Cinematic chase cue with punctuated hits, rising harmonic tension, and release cadence."
cue_purpose enum yes "chase"
mood enum yes "aggressive"
instrumentation enum yes "hybrid_orchestral"
tempo_bpm integer yes 96
duration_seconds integer yes 20
key_signature enum yes "D_minor"
time_signature enum yes "4/4"
audio_prompt_hint string no "Prioritize control-guided cue hits and sectional transitions while preserving melodic contour and arrangement intent."
prompt_template_id string yes "music-cue-pack-control-conditioned-v1"
style_profile_id string yes "music-cue-pack-control-guidance-v1"
sample_rate_hz integer yes 48000
target_lufs float yes -14
output_format enum yes "wav"
model_name string yes "ace_step_multilingual.safetensors"
seed integer yes 2026073105

Graph Nodes#

Node ID Class Role Output Count
n1 LoadImage pose-control-input 1
n2 LoadImage depth-control-input 1
n3 LoadImage segmentation-control-input 1
n4 LoadImage canny-control-input 1
n5 LoadImage lineart-control-input 1
n6 AudioPoseControlAdapter pose-control-adapter 1
n7 AudioDepthControlAdapter depth-control-adapter 1
n8 AudioSegmentationControlAdapter segmentation-control-adapter 1
n9 AudioTransientControlAdapter canny-control-adapter 1
n10 AudioRhythmControlAdapter lineart-control-adapter 1
n11 AudioControlSignalMixer control-signal-fusion 1
n12 ACEStepPromptBuilder prompt-construction 1
n13 ACEModelLoader model-load 1
n14 ACEStepAudioGenerator audio-generation 1
n15 AudioLoudnessNormalize audio-post 1
n16 SaveAudio artifact-output 0

Graph Edges#

Edge ID From To
e1 n1:0 n6.control_map
e2 n2:0 n7.control_map
e3 n3:0 n8.control_map
e4 n4:0 n9.control_map
e5 n5:0 n10.control_map
e6 n6:0 n11.pose_control
e7 n7:0 n11.depth_control
e8 n8:0 n11.segmentation_control
e9 n9:0 n11.canny_control
e10 n10:0 n11.lineart_control
e11 n12:0 n14.prompt
e12 n11:0 n14.control_signal
e13 n13:0 n14.model
e14 n14:0 n15.audio
e15 n15:0 n16.audio

Topological Node Order#

n1 -> n12 -> n13 -> n2 -> n3 -> n4 -> n5 -> n10 -> n6 -> n7 -> n8 -> n9 -> n11 -> n14 -> n15 -> n16

Research Alignment#

Workflow Path Control Nodes Audio Nodes Declared Control Inputs Node Classes
AnimateDiff with ControlNet libs/isis/workflows/src/workflows/video/animatediff-controlnet.json 3 0 AnimateDiffCombine, AnimateDiffLoader, AnimateDiffMotionModelSettings, CLIPTextEncode, CheckpointLoaderSimple, ControlNetApply, ControlNetLoader, ControlNetPreprocessor, EmptyLatentImage, KSampler, LoadImage, LoadImageSequence, LoopProcessor, SaveImage, TemporalConsistencyProcessor, VAEDecode, VHS_VideoCombine
Image to Video Animator libs/isis/workflows/src/workflows/video/image-to-video.json 0 0 AnimateDiffCombine, AnimateDiffLoader, AnimateDiffMotionModelSettings, BLIP_Caption, CLIPTextEncode, CheckpointLoaderSimple, ColorGrading, ImageResize, KSampler, LoadImage, LoopProcessor, RepeatLatentBatch, SaveImage, TemporalConsistencyProcessor, VAEDecode, VAEEncode, VHS_VideoCombine
Music Cue Composer libs/isis/workflows/src/workflows/audio/music-cue-composer.json 0 3 ACEModelLoader, ACEStepAudioGenerator, ACEStepPromptBuilder, AudioLimiter, SaveAudio

Acceptance Criteria#

  • Graph is acyclic and topologically sortable.
  • Pose/depth/segmentation/canny/lineart control paths are explicitly represented and mapped into audio control-signal adapters.
  • Pose control is explicitly optional where applicable and does not block runs when unavailable.
  • At least one control mode can be enabled per run while preserving deterministic seed/model defaults.
  • Event alignment and transient clarity tuning inputs are first-class controls in the input contract.
  • Output contract aligns to MXA-0559 required output classes for music-cue-pack.

Traceability#

  • Checklist item: MXA-0562
  • Ticket key: ISIS2-00760
  • Source references:
    • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MUSIC_CUE_PACK_REQUIREMENTS_BRIEF.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MUSIC_CUE_PACK_BASELINE_WORKFLOW_GRAPH.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MUSIC_CUE_PACK_IMAGE_CONDITIONED_WORKFLOW_GRAPH.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CONTROL_TAXONOMY.json
    • docs/domains/isis/remediation-v2/ISIS_V2_WORKFLOW_AUTHORING_GUIDE.json
    • libs/isis/workflows/src/workflows/video/animatediff-controlnet.json
    • libs/isis/workflows/src/workflows/video/image-to-video.json
    • libs/isis/workflows/src/workflows/audio/music-cue-composer.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_CONDITIONING_SUPPORT.md
    • docs/domains/isis/remediation-v2/ISIS_V2_OUTPUT_PACKAGE_TAXONOMY.json
    • ISIS_TODOS_2.md