Eve library

ISIS v2 Benchmark Dashboard

Guide

Revision 1

On this page

Generated At: 2026-07-15T13:11:24.437Z Source: scripts/isis/generate-v2-benchmark-dashboard.mjs

Headline Metrics#

  • Workflow count: 48
  • Node-class benchmark pass rate (WS01-007): 91.67%
  • Workflow capability benchmark pass rate (WS01-007): 100.00%
  • UX required capability pass rate (WS01-008): 100.00%
  • UX workflow pass rate (WS01-008): 100.00% (48/48)
  • Taxonomy category filter coverage: 100.00%
  • Control-mode quality benchmark pass rate (WS05-009): 81.58%
  • Required control-mode pass rate (WS05-009): 84.62%
  • Control-mode average quality score (WS05-009): 0.9720
  • Control-mode high-severity failure count (WS05-009): 0

Capability Gap Summary#

  • Missing required workflow capabilities: -
  • Failed required node targets: 1
    • mesh-export-stack: MeshExporter, GLTFExporter, FBXExporter

Missing UX Capabilities (Impact)#

Capability Impacted Workflows

Asset Drill-Down#

Asset Family Domain Impacted Workflows Missing Capabilities

Control Drill-Down#

Control Modality Impacted Workflows Missing Capabilities Sample Workflows

Control Failure Taxonomy Summary#

Failure Class Severity Impacted Controls Sample Controls
modality-coverage-gap medium 7 controlnet-inpaint, faceid, instantid, ipadapter-composition, ipadapter-face, +2 more
benchmark-score-gap medium 0 -
no-workflow-coverage critical 0 -
ux-capability-gap high 0 -
workflow-quality-gap high 0 -

Control Quality Drill-Down#

Control Quality Score Workflow Pass Capability Pass Modality Coverage Failure Classes
controlnet-inpaint 0.9000 100.00% 100.00% 33.33% modality-coverage-gap
faceid 0.9000 100.00% 100.00% 33.33% modality-coverage-gap
instantid 0.9000 100.00% 100.00% 33.33% modality-coverage-gap
ipadapter-composition 0.9000 100.00% 100.00% 33.33% modality-coverage-gap
ipadapter-face 0.9000 100.00% 100.00% 33.33% modality-coverage-gap
ipadapter-style 0.9000 100.00% 100.00% 33.33% modality-coverage-gap
lens-profile-lock 0.9250 100.00% 100.00% 50.00% modality-coverage-gap
controlnet-canny 0.9500 100.00% 100.00% 66.67% -
controlnet-lineart 0.9500 100.00% 100.00% 66.67% -
controlnet-scribble 0.9500 100.00% 100.00% 66.67% -
controlnet-softedge 0.9500 100.00% 100.00% 66.67% -
controlnet-tile 0.9500 100.00% 100.00% 66.67% -
keyframe-anchor-lock 0.9500 100.00% 100.00% 66.67% -
openpose-sequence 0.9500 100.00% 100.00% 66.67% -
identity-lock 0.9625 100.00% 100.00% 75.00% -
camera-lock 1.0000 100.00% 100.00% 100.00% -
camera-path-guide 1.0000 100.00% 100.00% 100.00% -
color-script-lock 1.0000 100.00% 100.00% 100.00% -
controlnet-depth 1.0000 100.00% 100.00% 100.00% -
controlnet-normal 1.0000 100.00% 100.00% 100.00% -
controlnet-pose 1.0000 100.00% 100.00% 100.00% -
controlnet-segmentation 1.0000 100.00% 100.00% 100.00% -
depth-constraint 1.0000 100.00% 100.00% 100.00% -
identity-adapter 1.0000 100.00% 100.00% 100.00% -
latent-reuse 1.0000 100.00% 100.00% 100.00% -
model-lock 1.0000 100.00% 100.00% 100.00% -
motion-vector-lock 1.0000 100.00% 100.00% 100.00% -
palette-lock 1.0000 100.00% 100.00% 100.00% -
pose-constraint 1.0000 100.00% 100.00% 100.00% -
prompt-template-lock 1.0000 100.00% 100.00% 100.00% -
reference-ensemble 1.0000 100.00% 100.00% 100.00% -
sampler-scheduler-lock 1.0000 100.00% 100.00% 100.00% -
scene-lock 1.0000 100.00% 100.00% 100.00% -
seed-lock 1.0000 100.00% 100.00% 100.00% -
style-anchor 1.0000 100.00% 100.00% 100.00% -
style-lock 1.0000 100.00% 100.00% 100.00% -
temporal-lock 1.0000 100.00% 100.00% 100.00% -
wardrobe-lock 1.0000 100.00% 100.00% 100.00% -

Consistency Drill-Down#

Consistency Dimension Impacted Workflows Missing Capabilities Sample Workflows

Traceability#

  • Checklist item: WS01-009
  • Upstream inputs: ISIS_V2_CAPABILITY_BENCHMARK.json, ISIS_V2_UX_INTERACTION_BENCHMARK.json, ISIS_V2_CONTROL_MODE_QUALITY_BENCHMARK.json
  • Drill-down taxonomy source: workflow-taxonomy-registry.json