Eve library

ISIS v2 User Telemetry and Qualitative Feedback Report

Guide

Revision 1

On this page

Generated: 2026-02-24T20:38:24.664Z Collection Window: 2026-02-11 -> 2026-02-24 (14 days)

Collection Modes#

  • UI telemetry source mode: file
  • Qualitative feedback source mode: file
  • Qualitative feedback responses: 10
  • Telemetry signals collected: 27

Telemetry Summary#

Signal Value
UX required capability pass rate 100.00%
UX workflow pass rate 100.00%
UI telemetry events 20
UI audit avg success latency 592.7ms
On-call reports considered 3

Top Route Activity#

Route Events
/outputs 4
/runpod 4
/workflows/wf-video 4
/jobs 3
/workflows/wf-character 3

Qualitative Theme Summary#

Theme Mentions Negative Mentions Avg Score
error-clarity 3 3 2.60
response-latency 3 3 2.50
form-complexity 3 2 2.47
comparison-usability 3 1 3.13
discoverability 2 2 2.45
batch-operations 2 1 2.80
export-packaging 1 0 4.30

Prioritized Ergonomic Improvements#

ID Priority Theme Owner Score Target Metric
ERG-001 P0 form-complexity @oshun/isis-team 62.52 Median parameter edits per successful run <= 7
ERG-002 P0 response-latency @oshun/platform 44.20 P95 UI action latency <= 900ms
ERG-003 P0 discoverability @oshun/isis-team 39.00 P90 control discovery time <= 25s
ERG-004 P0 comparison-usability @oshun/isis-team 38.08 Review completion time for comparison tasks <= 4 min
ERG-005 P1 error-clarity @oshun/isis-team 19.80 Error remediation success rate >= 85%
ERG-006 P2 batch-operations @oshun/platform 11.00 Bulk action completion attempts with no retries >= 90%

Action Details#

  • ERG-001 (P0) Form Complexity: Introduce per-workflow presets for common production variants. Collapse low-frequency parameters behind guided advanced toggles.
  • ERG-002 (P0) Interaction Latency and Responsiveness: Prioritize async status hydration for heavy route surfaces. Add route-level loading skeletons with optimistic controls for safe actions.
  • ERG-003 (P0) Control Discoverability: Re-group advanced controls into workflow-aware sections with anchored jump links. Add inline capability badges that map controls to output impact.
  • ERG-004 (P0) Comparison Workflow Usability: Persist compare workspace filters and annotation context across output switches. Add one-click timeline + quality overlay presets for reviewer personas.
  • ERG-005 (P1) Error Clarity and Recovery Guidance: Attach root-cause class and suggested remediation links to failed operations. Include correlation IDs in UI error surfaces for rapid on-call handoff.
  • ERG-006 (P2) Batch Operations Ergonomics: Consolidate multi-step queue actions into guided bulk operation dialogs. Pre-compute safety checks to remove redundant confirmation loops.

Traceability#

  • Checklist item: WS18-008
  • Input references: ISIS_V2_UX_INTERACTION_BENCHMARK.json, ISIS_V2_BENCHMARK_DASHBOARD.json, on-call triage reports, and qualitative feedback samples.