Eve library

ISIS v2 Capability Benchmark

Guide

Revision 1

On this page

Generated At: 2026-03-06T11:07:52.942Z Source: scripts/isis/run-v2-capability-benchmark.mjs

Summary#

  • Workflows analyzed: 48
  • Unique node classes detected: 114
  • Required node target pass rate: 91.67%
  • Required workflow capability pass rate: 100.00%

Node-Class Targets#

Target Mode Present/Total Coverage Result Missing Classes
core-generation allOf 4/4 100.00% PASS
latent-and-encode allOf 2/2 100.00% PASS
lora-adaptation anyOf 1/1 100.00% PASS
controlnet-stack allOf 3/3 100.00% PASS
ipadapter-stack allOf 2/2 100.00% PASS
video-temporal-stack allOf 3/3 100.00% PASS
frame-consistency anyOf 3/3 100.00% PASS
three-d-reconstruction anyOf 3/3 100.00% PASS
texture-material anyOf 3/3 100.00% PASS
batch-processing anyOf 3/3 100.00% PASS
audio-generation-stack anyOf 1/4 25.00% PASS AudioLoader, AudioEncode, AudioSampler
mesh-export-stack anyOf 0/3 0.00% FAIL MeshExporter, GLTFExporter, FBXExporter

Workflow Capability Targets#

Capability Required Observed Result
text-to-image yes yes PASS
image-to-image yes yes PASS
text-to-video yes yes PASS
image-to-video yes yes PASS
text-to-3d yes yes PASS
image-to-3d yes yes PASS
text-to-audio yes yes PASS
voice-synthesis yes yes PASS
music-generation yes yes PASS
upscaling yes yes PASS
inpainting yes yes PASS
controlnet-guided yes yes PASS
identity-consistency yes yes PASS
style-transfer yes yes PASS
batch-processing yes yes PASS
hdri-generation yes yes PASS
pbr-texture yes yes PASS
print-ready yes yes PASS

Missing Required Capabilities#

  • none

Missing Required Node Targets#

  • mesh-export-stack: missing MeshExporter, GLTFExporter, FBXExporter

Traceability#

  • Checklist item: WS01-007
  • Matrix source: docs/domains/isis/remediation-v2/ISIS_V2_COMFY_CAPABILITY_MATRIX.json
  • Runtime source: apps/isis/generation-api/src/routes/jobs.ts