# ISIS v2 Audio SFX Pack Control-Conditioned Workflow Graph

Generated: 2026-08-02T19:12:25.512Z Checklist: `MXA-0526` (ISIS2-00724) Asset
Family: `audio-sfx-pack` Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to
2026-10-30)

## Objective

Define a control-conditioned workflow graph for audio-sfx-pack that maps
pose/depth/segmentation/normal/canny/lineart control modalities into audio
guidance signals where applicable while preserving deterministic synthesis
defaults and mastered-audio output contracts.

## Deterministic Defaults

| Setting                        | Value                                   |
| ------------------------------ | --------------------------------------- |
| `modelName`                    | `stable_audio_open_1.0.safetensors`     |
| `promptTemplateId`             | `audio-sfx-pack-control-conditioned-v1` |
| `styleProfileId`               | `audio-sfx-pack-control-guidance-v1`    |
| `seed`                         | `2026073103`                            |
| `durationSeconds`              | `6`                                     |
| `sampleRateHz`                 | `48000`                                 |
| `targetLufs`                   | `-16`                                   |
| `outputFormat`                 | `wav`                                   |
| `outputChannels`               | `2`                                     |
| `outputBitDepth`               | `24`                                    |
| `controlApplicabilityMode`     | `where-applicable`                      |
| `controlSignalFusion`          | `weighted-sum`                          |
| `providerCapabilityMode`       | `required`                              |
| `minimumEnabledControlsPerRun` | `1`                                     |
| `poseStrength`                 | `0.42`                                  |
| `depthStrength`                | `0.66`                                  |
| `segmentationStrength`         | `0.58`                                  |
| `normalStrength`               | `0.6`                                   |
| `cannyStrength`                | `0.52`                                  |
| `lineartStrength`              | `0.49`                                  |
| `eventAlignmentMode`           | `transient-priority`                    |

## Input Contract

| Input                        | Type    | Required | Default                                                                                       |
| ---------------------------- | ------- | -------- | --------------------------------------------------------------------------------------------- |
| `pose_map`                   | image   | no       | n/a                                                                                           |
| `depth_map`                  | image   | no       | n/a                                                                                           |
| `segmentation_map`           | image   | no       | n/a                                                                                           |
| `normal_map`                 | image   | no       | n/a                                                                                           |
| `edge_map`                   | image   | no       | n/a                                                                                           |
| `lineart_map`                | image   | no       | n/a                                                                                           |
| `use_pose_control`           | boolean | yes      | `false`                                                                                       |
| `use_depth_control`          | boolean | yes      | `true`                                                                                        |
| `use_segmentation_control`   | boolean | yes      | `true`                                                                                        |
| `use_normal_control`         | boolean | yes      | `true`                                                                                        |
| `use_canny_control`          | boolean | yes      | `true`                                                                                        |
| `use_lineart_control`        | boolean | yes      | `false`                                                                                       |
| `pose_strength`              | float   | yes      | `0.42`                                                                                        |
| `depth_strength`             | float   | yes      | `0.66`                                                                                        |
| `segmentation_strength`      | float   | yes      | `0.58`                                                                                        |
| `normal_strength`            | float   | yes      | `0.6`                                                                                         |
| `canny_strength`             | float   | yes      | `0.52`                                                                                        |
| `lineart_strength`           | float   | yes      | `0.49`                                                                                        |
| `control_applicability_mode` | enum    | yes      | `"where-applicable"`                                                                          |
| `control_signal_fusion`      | enum    | yes      | `"weighted-sum"`                                                                              |
| `control_profile_id`         | string  | yes      | `"AUDIO_SFX_CONTROL_PROFILE_V1"`                                                              |
| `control_timeline_fps`       | integer | yes      | `24`                                                                                          |
| `event_alignment_mode`       | enum    | yes      | `"transient-priority"`                                                                        |
| `cue_id`                     | string  | yes      | `"AUDIO_SFX_M3_CONTROL_CONDITIONED_01"`                                                       |
| `prompt`                     | string  | yes      | `"High-pressure hydraulic release followed by metallic snap and short concrete tail."`        |
| `sfx_type`                   | enum    | yes      | `"foley"`                                                                                     |
| `intensity`                  | enum    | yes      | `"strong"`                                                                                    |
| `spatial_profile`            | enum    | yes      | `"cinematic"`                                                                                 |
| `duration_seconds`           | integer | yes      | `6`                                                                                           |
| `audio_prompt_hint`          | string  | no       | `"Prioritize transient lock to control-guided onsets while preserving low-noise tail decay."` |
| `prompt_template_id`         | string  | yes      | `"audio-sfx-pack-control-conditioned-v1"`                                                     |
| `style_profile_id`           | string  | yes      | `"audio-sfx-pack-control-guidance-v1"`                                                        |
| `sample_rate_hz`             | integer | yes      | `48000`                                                                                       |
| `target_lufs`                | float   | yes      | `-16`                                                                                         |
| `output_format`              | enum    | yes      | `"wav"`                                                                                       |
| `model_name`                 | string  | yes      | `"stable_audio_open_1.0.safetensors"`                                                         |
| `seed`                       | integer | yes      | `2026073103`                                                                                  |

## Graph Nodes

| Node ID | Class                             | Role                         | Output Count |
| ------- | --------------------------------- | ---------------------------- | ------------ |
| `n1`    | `LoadImage`                       | pose-control-input           | 1            |
| `n2`    | `LoadImage`                       | depth-control-input          | 1            |
| `n3`    | `LoadImage`                       | segmentation-control-input   | 1            |
| `n4`    | `LoadImage`                       | canny-control-input          | 1            |
| `n17`   | `LoadImage`                       | normal-control-input         | 1            |
| `n5`    | `LoadImage`                       | lineart-control-input        | 1            |
| `n6`    | `AudioPoseControlAdapter`         | pose-control-adapter         | 1            |
| `n7`    | `AudioDepthControlAdapter`        | depth-control-adapter        | 1            |
| `n8`    | `AudioSegmentationControlAdapter` | segmentation-control-adapter | 1            |
| `n9`    | `AudioTransientControlAdapter`    | canny-control-adapter        | 1            |
| `n18`   | `AudioNormalControlAdapter`       | normal-control-adapter       | 1            |
| `n10`   | `AudioRhythmControlAdapter`       | lineart-control-adapter      | 1            |
| `n11`   | `AudioControlSignalMixer`         | control-signal-fusion        | 1            |
| `n12`   | `StableAudioPromptComposer`       | prompt-construction          | 1            |
| `n13`   | `StableAudioOpenModelLoader`      | model-load                   | 1            |
| `n14`   | `StableAudioNode`                 | audio-generation             | 1            |
| `n15`   | `AudioLoudnessNormalize`          | audio-post                   | 1            |
| `n16`   | `SaveAudio`                       | artifact-output              | 0            |

## Graph Edges

| Edge ID | From    | To                         |
| ------- | ------- | -------------------------- |
| `e1`    | `n1:0`  | `n6.control_map`           |
| `e2`    | `n2:0`  | `n7.control_map`           |
| `e3`    | `n3:0`  | `n8.control_map`           |
| `e4`    | `n4:0`  | `n9.control_map`           |
| `e5`    | `n5:0`  | `n10.control_map`          |
| `e6`    | `n6:0`  | `n11.pose_control`         |
| `e7`    | `n7:0`  | `n11.depth_control`        |
| `e8`    | `n8:0`  | `n11.segmentation_control` |
| `e9`    | `n9:0`  | `n11.canny_control`        |
| `e10`   | `n10:0` | `n11.lineart_control`      |
| `e11`   | `n12:0` | `n14.prompt`               |
| `e12`   | `n11:0` | `n14.control_signal`       |
| `e13`   | `n13:0` | `n14.model`                |
| `e14`   | `n14:0` | `n15.audio`                |
| `e15`   | `n15:0` | `n16.audio`                |
| `e16`   | `n17:0` | `n18.control_map`          |
| `e17`   | `n18:0` | `n11.normal_control`       |

## Topological Node Order

`n1` -> `n12` -> `n13` -> `n17` -> `n18` -> `n2` -> `n3` -> `n4` -> `n5` ->
`n10` -> `n6` -> `n7` -> `n8` -> `n9` -> `n11` -> `n14` -> `n15` -> `n16`

## Research Alignment

| Workflow                    | Path                                                                  | Control Nodes | Audio Nodes | Declared Control Inputs | Node Classes                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
| --------------------------- | --------------------------------------------------------------------- | ------------- | ----------- | ----------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| AnimateDiff with ControlNet | `libs/isis/workflows/src/workflows/video/animatediff-controlnet.json` | 3             | 0           |                         | `ADE_AnimateDiffLoaderGen1`, `ADE_MultivalDynamic`, `ADE_StandardUniformContextOptions`, `CLIPTextEncode`, `CheckpointLoaderSimple`, `ControlNetApply`, `ControlNetLoader`, `EmptyLatentImage`, `ImageScaleBy`, `ImageUpscaleWithModel`, `IsisLoadImageList`, `KSampler`, `LoopProcessor`, `LoraLoaderModelOnly`, `RIFE VFI`, `SaveImage`, `TemporalConsistencyProcessor`, `UpscaleModelLoader`, `VAEDecode`, `VHS_VideoCombine`, `{{control_mode_configs[control_mode].preprocessor}}` |
| Image to Video Animator     | `libs/isis/workflows/src/workflows/video/image-to-video.json`         | 0             | 0           |                         | `ADE_AnimateDiffLoaderGen1`, `ADE_MultivalDynamic`, `ADE_StandardUniformContextOptions`, `BLIP_Caption`, `CLIPTextEncode`, `CheckpointLoaderSimple`, `ColorGrading`, `ImageScale`, `ImageScaleBy`, `ImageUpscaleWithModel`, `IsisTextConcat`, `KSampler`, `LoadImage`, `LoopProcessor`, `LoraLoaderModelOnly`, `RIFE VFI`, `RepeatLatentBatch`, `SaveImage`, `TemporalConsistencyProcessor`, `UpscaleModelLoader`, `VAEDecode`, `VAEEncode`, `VHS_VideoCombine`                         |
| SFX Sound Designer          | `libs/isis/workflows/src/workflows/audio/sfx-sound-designer.json`     | 0             | 4           |                         | `AudioLoudnessNormalize`, `CLIPLoader`, `CLIPTextEncode`, `CheckpointLoaderSimple`, `EmptyLatentAudio`, `KSampler`, `SaveAudioMP3`, `VAEDecodeAudio`                                                                                                                                                                                                                                                                                                                                    |

## Acceptance Criteria

- Graph is acyclic and topologically sortable.
- Pose/depth/segmentation/normal/canny/lineart control paths are explicitly
  represented and mapped into audio control-signal adapters.
- Pose control is explicitly optional where applicable and does not block runs
  when unavailable.
- At least one control mode can be enabled per run while preserving
  deterministic seed/model defaults.
- Event alignment and transient clarity tuning inputs are first-class controls
  in the input contract.
- Output contract aligns to MXA-0523 required output classes for audio-sfx-pack.

## Traceability

- Checklist item: `MXA-0526`
- Ticket key: `ISIS2-00724`
- Source references:
  - `docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json`
  - `docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_REQUIREMENTS_BRIEF.json`
  - `docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_BASELINE_WORKFLOW_GRAPH.json`
  - `docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_IMAGE_CONDITIONED_WORKFLOW_GRAPH.json`
  - `docs/domains/isis/remediation-v2/ISIS_V2_CONTROL_TAXONOMY.json`
  - `docs/domains/isis/remediation-v2/ISIS_V2_WORKFLOW_AUTHORING_GUIDE.json`
  - `libs/isis/workflows/src/workflows/video/animatediff-controlnet.json`
  - `libs/isis/workflows/src/workflows/video/image-to-video.json`
  - `libs/isis/workflows/src/workflows/audio/sfx-sound-designer.json`
  - `docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_CONDITIONING_SUPPORT.md`
  - `docs/domains/isis/remediation-v2/ISIS_V2_OUTPUT_PACKAGE_TAXONOMY.json`
  - `ISIS_TODOS_2.md`
