Eve library

ISIS v2 Audio SFX Pack Control-Conditioned Workflow Graph

Guide

Revision 1

On this page

Generated: 2026-08-02T19:12:25.512Z Checklist: MXA-0526 (ISIS2-00724) Asset Family: audio-sfx-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Define a control-conditioned workflow graph for audio-sfx-pack that maps pose/depth/segmentation/normal/canny/lineart control modalities into audio guidance signals where applicable while preserving deterministic synthesis defaults and mastered-audio output contracts.

Deterministic Defaults#

Setting Value
modelName stable_audio_open_1.0.safetensors
promptTemplateId audio-sfx-pack-control-conditioned-v1
styleProfileId audio-sfx-pack-control-guidance-v1
seed 2026073103
durationSeconds 6
sampleRateHz 48000
targetLufs -16
outputFormat wav
outputChannels 2
outputBitDepth 24
controlApplicabilityMode where-applicable
controlSignalFusion weighted-sum
providerCapabilityMode required
minimumEnabledControlsPerRun 1
poseStrength 0.42
depthStrength 0.66
segmentationStrength 0.58
normalStrength 0.6
cannyStrength 0.52
lineartStrength 0.49
eventAlignmentMode transient-priority

Input Contract#

Input Type Required Default
pose_map image no n/a
depth_map image no n/a
segmentation_map image no n/a
normal_map image no n/a
edge_map image no n/a
lineart_map image no n/a
use_pose_control boolean yes false
use_depth_control boolean yes true
use_segmentation_control boolean yes true
use_normal_control boolean yes true
use_canny_control boolean yes true
use_lineart_control boolean yes false
pose_strength float yes 0.42
depth_strength float yes 0.66
segmentation_strength float yes 0.58
normal_strength float yes 0.6
canny_strength float yes 0.52
lineart_strength float yes 0.49
control_applicability_mode enum yes "where-applicable"
control_signal_fusion enum yes "weighted-sum"
control_profile_id string yes "AUDIO_SFX_CONTROL_PROFILE_V1"
control_timeline_fps integer yes 24
event_alignment_mode enum yes "transient-priority"
cue_id string yes "AUDIO_SFX_M3_CONTROL_CONDITIONED_01"
prompt string yes "High-pressure hydraulic release followed by metallic snap and short concrete tail."
sfx_type enum yes "foley"
intensity enum yes "strong"
spatial_profile enum yes "cinematic"
duration_seconds integer yes 6
audio_prompt_hint string no "Prioritize transient lock to control-guided onsets while preserving low-noise tail decay."
prompt_template_id string yes "audio-sfx-pack-control-conditioned-v1"
style_profile_id string yes "audio-sfx-pack-control-guidance-v1"
sample_rate_hz integer yes 48000
target_lufs float yes -16
output_format enum yes "wav"
model_name string yes "stable_audio_open_1.0.safetensors"
seed integer yes 2026073103

Graph Nodes#

Node ID Class Role Output Count
n1 LoadImage pose-control-input 1
n2 LoadImage depth-control-input 1
n3 LoadImage segmentation-control-input 1
n4 LoadImage canny-control-input 1
n17 LoadImage normal-control-input 1
n5 LoadImage lineart-control-input 1
n6 AudioPoseControlAdapter pose-control-adapter 1
n7 AudioDepthControlAdapter depth-control-adapter 1
n8 AudioSegmentationControlAdapter segmentation-control-adapter 1
n9 AudioTransientControlAdapter canny-control-adapter 1
n18 AudioNormalControlAdapter normal-control-adapter 1
n10 AudioRhythmControlAdapter lineart-control-adapter 1
n11 AudioControlSignalMixer control-signal-fusion 1
n12 StableAudioPromptComposer prompt-construction 1
n13 StableAudioOpenModelLoader model-load 1
n14 StableAudioNode audio-generation 1
n15 AudioLoudnessNormalize audio-post 1
n16 SaveAudio artifact-output 0

Graph Edges#

Edge ID From To
e1 n1:0 n6.control_map
e2 n2:0 n7.control_map
e3 n3:0 n8.control_map
e4 n4:0 n9.control_map
e5 n5:0 n10.control_map
e6 n6:0 n11.pose_control
e7 n7:0 n11.depth_control
e8 n8:0 n11.segmentation_control
e9 n9:0 n11.canny_control
e10 n10:0 n11.lineart_control
e11 n12:0 n14.prompt
e12 n11:0 n14.control_signal
e13 n13:0 n14.model
e14 n14:0 n15.audio
e15 n15:0 n16.audio
e16 n17:0 n18.control_map
e17 n18:0 n11.normal_control

Topological Node Order#

n1 -> n12 -> n13 -> n17 -> n18 -> n2 -> n3 -> n4 -> n5 -> n10 -> n6 -> n7 -> n8 -> n9 -> n11 -> n14 -> n15 -> n16

Research Alignment#

Workflow Path Control Nodes Audio Nodes Declared Control Inputs Node Classes
AnimateDiff with ControlNet libs/isis/workflows/src/workflows/video/animatediff-controlnet.json 3 0 ADE_AnimateDiffLoaderGen1, ADE_MultivalDynamic, ADE_StandardUniformContextOptions, CLIPTextEncode, CheckpointLoaderSimple, ControlNetApply, ControlNetLoader, EmptyLatentImage, ImageScaleBy, ImageUpscaleWithModel, IsisLoadImageList, KSampler, LoopProcessor, LoraLoaderModelOnly, RIFE VFI, SaveImage, TemporalConsistencyProcessor, UpscaleModelLoader, VAEDecode, VHS_VideoCombine, {{control_mode_configs[control_mode].preprocessor}}
Image to Video Animator libs/isis/workflows/src/workflows/video/image-to-video.json 0 0 ADE_AnimateDiffLoaderGen1, ADE_MultivalDynamic, ADE_StandardUniformContextOptions, BLIP_Caption, CLIPTextEncode, CheckpointLoaderSimple, ColorGrading, ImageScale, ImageScaleBy, ImageUpscaleWithModel, IsisTextConcat, KSampler, LoadImage, LoopProcessor, LoraLoaderModelOnly, RIFE VFI, RepeatLatentBatch, SaveImage, TemporalConsistencyProcessor, UpscaleModelLoader, VAEDecode, VAEEncode, VHS_VideoCombine
SFX Sound Designer libs/isis/workflows/src/workflows/audio/sfx-sound-designer.json 0 4 AudioLoudnessNormalize, CLIPLoader, CLIPTextEncode, CheckpointLoaderSimple, EmptyLatentAudio, KSampler, SaveAudioMP3, VAEDecodeAudio

Acceptance Criteria#

  • Graph is acyclic and topologically sortable.
  • Pose/depth/segmentation/normal/canny/lineart control paths are explicitly represented and mapped into audio control-signal adapters.
  • Pose control is explicitly optional where applicable and does not block runs when unavailable.
  • At least one control mode can be enabled per run while preserving deterministic seed/model defaults.
  • Event alignment and transient clarity tuning inputs are first-class controls in the input contract.
  • Output contract aligns to MXA-0523 required output classes for audio-sfx-pack.

Traceability#

  • Checklist item: MXA-0526
  • Ticket key: ISIS2-00724
  • Source references:
    • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_REQUIREMENTS_BRIEF.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_BASELINE_WORKFLOW_GRAPH.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_IMAGE_CONDITIONED_WORKFLOW_GRAPH.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CONTROL_TAXONOMY.json
    • docs/domains/isis/remediation-v2/ISIS_V2_WORKFLOW_AUTHORING_GUIDE.json
    • libs/isis/workflows/src/workflows/video/animatediff-controlnet.json
    • libs/isis/workflows/src/workflows/video/image-to-video.json
    • libs/isis/workflows/src/workflows/audio/sfx-sound-designer.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_CONDITIONING_SUPPORT.md
    • docs/domains/isis/remediation-v2/ISIS_V2_OUTPUT_PACKAGE_TAXONOMY.json
    • ISIS_TODOS_2.md