# ISIS v2 User Telemetry and Qualitative Feedback Report

Generated: 2026-02-24T20:38:24.664Z Collection Window: 2026-02-11 -> 2026-02-24
(14 days)

## Collection Modes

- UI telemetry source mode: file
- Qualitative feedback source mode: file
- Qualitative feedback responses: 10
- Telemetry signals collected: 27

## Telemetry Summary

| Signal                           |   Value |
| -------------------------------- | ------: |
| UX required capability pass rate | 100.00% |
| UX workflow pass rate            | 100.00% |
| UI telemetry events              |      20 |
| UI audit avg success latency     | 592.7ms |
| On-call reports considered       |       3 |

### Top Route Activity

| Route                   | Events |
| ----------------------- | -----: |
| /outputs                |      4 |
| /runpod                 |      4 |
| /workflows/wf-video     |      4 |
| /jobs                   |      3 |
| /workflows/wf-character |      3 |

## Qualitative Theme Summary

| Theme                | Mentions | Negative Mentions | Avg Score |
| -------------------- | -------: | ----------------: | --------: |
| error-clarity        |        3 |                 3 |      2.60 |
| response-latency     |        3 |                 3 |      2.50 |
| form-complexity      |        3 |                 2 |      2.47 |
| comparison-usability |        3 |                 1 |      3.13 |
| discoverability      |        2 |                 2 |      2.45 |
| batch-operations     |        2 |                 1 |      2.80 |
| export-packaging     |        1 |                 0 |      4.30 |

## Prioritized Ergonomic Improvements

| ID      | Priority | Theme                | Owner            | Score | Target Metric                                          |
| ------- | -------- | -------------------- | ---------------- | ----: | ------------------------------------------------------ |
| ERG-001 | P0       | form-complexity      | @oshun/isis-team | 62.52 | Median parameter edits per successful run <= 7         |
| ERG-002 | P0       | response-latency     | @oshun/platform  | 44.20 | P95 UI action latency <= 900ms                         |
| ERG-003 | P0       | discoverability      | @oshun/isis-team | 39.00 | P90 control discovery time <= 25s                      |
| ERG-004 | P0       | comparison-usability | @oshun/isis-team | 38.08 | Review completion time for comparison tasks <= 4 min   |
| ERG-005 | P1       | error-clarity        | @oshun/isis-team | 19.80 | Error remediation success rate >= 85%                  |
| ERG-006 | P2       | batch-operations     | @oshun/platform  | 11.00 | Bulk action completion attempts with no retries >= 90% |

### Action Details

- ERG-001 (P0) Form Complexity: Introduce per-workflow presets for common
  production variants. Collapse low-frequency parameters behind guided advanced
  toggles.
- ERG-002 (P0) Interaction Latency and Responsiveness: Prioritize async status
  hydration for heavy route surfaces. Add route-level loading skeletons with
  optimistic controls for safe actions.
- ERG-003 (P0) Control Discoverability: Re-group advanced controls into
  workflow-aware sections with anchored jump links. Add inline capability badges
  that map controls to output impact.
- ERG-004 (P0) Comparison Workflow Usability: Persist compare workspace filters
  and annotation context across output switches. Add one-click timeline +
  quality overlay presets for reviewer personas.
- ERG-005 (P1) Error Clarity and Recovery Guidance: Attach root-cause class and
  suggested remediation links to failed operations. Include correlation IDs in
  UI error surfaces for rapid on-call handoff.
- ERG-006 (P2) Batch Operations Ergonomics: Consolidate multi-step queue actions
  into guided bulk operation dialogs. Pre-compute safety checks to remove
  redundant confirmation loops.

## Traceability

- Checklist item: `WS18-008`
- Input references: `ISIS_V2_UX_INTERACTION_BENCHMARK.json`,
  `ISIS_V2_BENCHMARK_DASHBOARD.json`, on-call triage reports, and qualitative
  feedback samples.
