Eve library

ISIS v2 VFX Element Pack Control-Conditioned Workflow Graph

Guide

Revision 1

On this page

Generated: 2026-08-02T18:33:39.049Z Checklist: MXA-0418 (ISIS2-00616) Asset Family: vfx-element-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Define a control-conditioned workflow graph for vfx-element-pack that supports pose/depth/segmentation/normal/canny/lineart guidance where applicable while preserving deterministic compositing-ready defaults.

Deterministic Defaults#

Setting Value
checkpointModel sd_xl_base_1.0.safetensors
promptTemplateId vfx-element-pack-control-conditioned-v1
styleProfileId vfx-element-pack-style-anchor-v1
colorScript ember-orange emission core, neutral smoke mids, cool blue edge falloff for additive comp separation
lensProfile vfx-element-35mm-comp-plate
seed 2026111803
width 1920
height 1080
steps 36
cfgScale 5.6
samplerName dpmpp_2m_sde
scheduler karras
denoise 1
poseControlModel control_v11p_sd15_openpose.safetensors
depthControlModel control_v11f1p_sd15_depth.safetensors
segmentationControlModel control_v11p_sd15_seg.safetensors
normalControlModel control_v11p_sd15_normalbae.safetensors
cannyControlModel control_v11p_sd15_canny.safetensors
lineartControlModel control_v11p_sd15s2_lineart_anime.safetensors
poseStrength 0.68
depthStrength 0.76
segmentationStrength 0.66
normalStrength 0.62
cannyStrength 0.54
lineartStrength 0.5
batchSize 1
outputFormat png
outputChannels 4

Input Contract#

Input Type Required Default
pose_map image no n/a
depth_map image no n/a
segmentation_map image no n/a
normal_map image no n/a
edge_map image no n/a
lineart_map image no n/a
use_pose_control boolean yes false
use_depth_control boolean yes true
use_segmentation_control boolean yes true
use_normal_control boolean yes true
use_canny_control boolean yes false
use_lineart_control boolean yes false
pose_strength float yes 0.68
depth_strength float yes 0.76
segmentation_strength float yes 0.66
normal_strength float yes 0.62
canny_strength float yes 0.54
lineart_strength float yes 0.5
effect_type enum yes smoke-plume
style_profile enum yes photoreal-cinematic
shot_context enum yes mid-shot
lighting_interaction_profile enum yes backlit-volumetric
medium_profile enum yes dense-smoke
motion_profile enum yes directional-sweep
element_density_profile enum yes balanced
turbulence_profile enum yes medium
emission_color_profile enum yes warm-ember
alpha_background_mode enum yes transparent
render_resolution_class enum yes 1080p
camera_lens_profile enum yes standard-35mm
compositing_intent string yes foreground/mid/background layer separability with clean alpha edges and stable luminance for comp stack blending
prompt_template_id string yes vfx-element-pack-control-conditioned-v1
style_profile_id string yes vfx-element-pack-style-anchor-v1
color_script string yes ember-orange emission core, neutral smoke mids, cool blue edge falloff for additive comp separation
lens_profile string yes vfx-element-35mm-comp-plate
negative_prompt string no matte fringing, edge halos, chroma spill, clipping, segmentation bleed, warped depth cues, noisy edge halos, duplicate ghost trails, watermark, jpeg artifacts
seed integer yes 2026111803
width integer yes 1920
height integer yes 1080
steps integer yes 36
cfg_scale float yes 5.6

Graph Nodes#

Node ID Class Role Output Count
n1 LoadImage depth-control-input 2
n2 LoadImage segmentation-control-input 2
n3 LoadImage normal-control-input 2
n4 LoadImage canny-control-input 2
n5 LoadImage lineart-control-input 2
n23 LoadImage pose-control-input 2
n6 CheckpointLoaderSimple model-load 3
n7 ControlNetLoader depth-control-load 1
n8 ControlNetLoader segmentation-control-load 1
n9 ControlNetLoader normal-control-load 1
n10 ControlNetLoader canny-control-load 1
n11 ControlNetLoader lineart-control-load 1
n24 ControlNetLoader pose-control-load 1
n12 CLIPTextEncode positive-conditioning 1
n13 CLIPTextEncode negative-conditioning 1
n25 ControlNetApply pose-control-apply 1
n14 ControlNetApply depth-control-apply 1
n15 ControlNetApply segmentation-control-apply 1
n16 ControlNetApply normal-control-apply 1
n17 ControlNetApply canny-control-apply 1
n18 ControlNetApply lineart-control-apply 1
n19 EmptyLatentImage latent-init 1
n20 KSampler latent-sample 1
n21 VAEDecode image-decode 1
n22 SaveImage artifact-output 0

Graph Edges#

Edge ID From To
e1 n6:0 n20.model
e2 n6:1 n12.clip
e3 n6:1 n13.clip
e4 n6:2 n21.vae
e4a n12:0 n25.conditioning
e4b n24:0 n25.control_net
e4c n23:0 n25.image
e5 n25:0 n14.conditioning
e6 n7:0 n14.control_net
e7 n1:0 n14.image
e8 n14:0 n15.conditioning
e9 n8:0 n15.control_net
e10 n2:0 n15.image
e11 n15:0 n16.conditioning
e12 n9:0 n16.control_net
e13 n3:0 n16.image
e14 n16:0 n17.conditioning
e15 n10:0 n17.control_net
e16 n4:0 n17.image
e17 n17:0 n18.conditioning
e18 n11:0 n18.control_net
e19 n5:0 n18.image
e20 n18:0 n20.positive
e21 n13:0 n20.negative
e22 n19:0 n20.latent_image
e23 n20:0 n21.samples
e24 n21:0 n22.images

Topological Node Order#

n1 -> n10 -> n11 -> n19 -> n2 -> n23 -> n24 -> n3 -> n4 -> n5 -> n6 -> n12 -> n13 -> n25 -> n7 -> n14 -> n8 -> n15 -> n9 -> n16 -> n17 -> n18 -> n20 -> n21 -> n22

Research Alignment#

Workflow Path Control Nodes
AnimateDiff with ControlNet libs/isis/workflows/src/workflows/video/animatediff-controlnet.json 2
3D Texture Generator libs/isis/workflows/src/workflows/texture/3d-texture.json 0
HDRI Environment Map Generator libs/isis/workflows/src/workflows/texture/environment-map.json 0

Acceptance Criteria#

  • Graph is acyclic and topologically sortable.
  • Depth/segmentation/normal/canny/lineart control paths are explicitly represented through ControlNet loaders and apply nodes.
  • At least one control mode can be enabled per run without breaking deterministic sampler/model defaults.
  • Pose control is explicitly supported as optional where applicable.
  • Output contract aligns to MXA-0415 required output classes.
  • Compositing-safe edge continuity and controlled element structure remain first-class required inputs for controlled generation.

Traceability#

  • Checklist item: MXA-0418
  • Ticket key: ISIS2-00616
  • Source references:
    • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VFX_ELEMENT_PACK_REQUIREMENTS_BRIEF.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VFX_ELEMENT_PACK_BASELINE_WORKFLOW_GRAPH.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VFX_ELEMENT_PACK_IMAGE_CONDITIONED_WORKFLOW_GRAPH.json
    • libs/isis/workflows/src/workflows/video/animatediff-controlnet.json
    • libs/isis/workflows/src/workflows/texture/3d-texture.json
    • libs/isis/workflows/src/workflows/texture/environment-map.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CONTROL_TAXONOMY.json
    • docs/domains/isis/remediation-v2/ISIS_V2_WORKFLOW_AUTHORING_GUIDE.json
    • docs/domains/isis/remediation-v2/ISIS_V2_OUTPUT_PACKAGE_TAXONOMY.json
    • ISIS_TODOS_2.md