# ISIS v2 Control-Mode Quality Benchmark

Generated At: 2026-03-06T11:07:55.343Z Source:
`scripts/isis/run-v2-control-mode-quality-benchmark.mjs`

## Summary

- Controls analyzed: 38
- Required controls analyzed: 26
- Passed controls: 31
- Failing controls: 7
- Overall control pass rate: 81.58%
- Required control pass rate: 84.62%
- Average quality score: 0.9720
- High-severity control gaps: 0

## Failure Taxonomy

| Class                   | Severity | Description                                                                                       | Impacted Controls |
| ----------------------- | -------- | ------------------------------------------------------------------------------------------------- | ----------------: |
| `no-workflow-coverage`  | critical | Control modality is defined in taxonomy but not used by any workflow.                             |                 0 |
| `ux-capability-gap`     | high     | Control-specific UX capability mappings are missing or failing benchmark probes.                  |                 0 |
| `workflow-quality-gap`  | high     | One or more workflows using this control fail required UX quality coverage checks.                |                 0 |
| `modality-coverage-gap` | medium   | Observed workflow modality coverage for the control does not match declared supported modalities. |                 7 |
| `benchmark-score-gap`   | medium   | Composite benchmark score is below pass threshold (0.75).                                         |                 0 |

## Per-Control Benchmark

| Control                   | Required | Workflows | Workflow Pass | Capability Pass | Modality Coverage |  Score | Result | Failures                |
| ------------------------- | -------- | --------: | ------------: | --------------: | ----------------: | -----: | ------ | ----------------------- |
| `controlnet-inpaint`      | no       |         2 |       100.00% |         100.00% |            33.33% | 0.9000 | FAIL   | `modality-coverage-gap` |
| `faceid`                  | yes      |         2 |       100.00% |         100.00% |            33.33% | 0.9000 | FAIL   | `modality-coverage-gap` |
| `instantid`               | yes      |         1 |       100.00% |         100.00% |            33.33% | 0.9000 | FAIL   | `modality-coverage-gap` |
| `ipadapter-composition`   | no       |         1 |       100.00% |         100.00% |            33.33% | 0.9000 | FAIL   | `modality-coverage-gap` |
| `ipadapter-face`          | yes      |         5 |       100.00% |         100.00% |            33.33% | 0.9000 | FAIL   | `modality-coverage-gap` |
| `ipadapter-style`         | yes      |         2 |       100.00% |         100.00% |            33.33% | 0.9000 | FAIL   | `modality-coverage-gap` |
| `lens-profile-lock`       | no       |         4 |       100.00% |         100.00% |            50.00% | 0.9250 | FAIL   | `modality-coverage-gap` |
| `controlnet-canny`        | yes      |         1 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `controlnet-lineart`      | yes      |         1 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `controlnet-scribble`     | no       |         1 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `controlnet-softedge`     | no       |         1 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `controlnet-tile`         | no       |         3 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `keyframe-anchor-lock`    | no       |         7 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `openpose-sequence`       | yes      |         1 |       100.00% |         100.00% |            66.67% | 0.9500 | PASS   | -                       |
| `identity-lock`           | yes      |         7 |       100.00% |         100.00% |            75.00% | 0.9625 | PASS   | -                       |
| `camera-lock`             | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `camera-path-guide`       | yes      |         7 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `color-script-lock`       | no       |        42 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `controlnet-depth`        | yes      |         6 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `controlnet-normal`       | yes      |         5 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `controlnet-pose`         | yes      |         2 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `controlnet-segmentation` | yes      |         3 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `depth-constraint`        | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `identity-adapter`        | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `latent-reuse`            | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `model-lock`              | no       |        48 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `motion-vector-lock`      | no       |         7 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `palette-lock`            | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `pose-constraint`         | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `prompt-template-lock`    | no       |        46 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `reference-ensemble`      | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `sampler-scheduler-lock`  | no       |        48 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `scene-lock`              | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `seed-lock`               | yes      |        48 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `style-anchor`            | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `style-lock`              | yes      |        46 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `temporal-lock`           | yes      |        27 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |
| `wardrobe-lock`           | yes      |        26 |       100.00% |         100.00% |           100.00% | 1.0000 | PASS   | -                       |

## Top Failing Controls

- `controlnet-inpaint`: score 0.9000, failures `modality-coverage-gap`, missing
  capabilities -
- `faceid`: score 0.9000, failures `modality-coverage-gap`, missing
  capabilities -
- `instantid`: score 0.9000, failures `modality-coverage-gap`, missing
  capabilities -
- `ipadapter-composition`: score 0.9000, failures `modality-coverage-gap`,
  missing capabilities -
- `ipadapter-face`: score 0.9000, failures `modality-coverage-gap`, missing
  capabilities -
- `ipadapter-style`: score 0.9000, failures `modality-coverage-gap`, missing
  capabilities -
- `lens-profile-lock`: score 0.9250, failures `modality-coverage-gap`, missing
  capabilities -

## Traceability

- Checklist item: `WS05-009`
- Inputs: `ISIS_V2_CONTROL_TAXONOMY.json`, `workflow-taxonomy-registry.json`,
  `ISIS_V2_UX_INTERACTION_BENCHMARK.json`, `ISIS_V2_UX_INTERACTION_MATRIX.json`
