Scope#
WS11-010 operationalizes ISIS web UX quality by:
- running reproducible UX benchmark studies,
- iterating the product surface to remove benchmark gaps,
- locking measurable ergonomics targets into regression gates.
Research and Existing Implementation Alignment#
Implementation and iteration were grounded in existing in-repo benchmark and UX contracts:
- UX benchmark runner:
scripts/isis/run-v2-ux-interaction-benchmark.mjs - regression gate:
scripts/isis/validate-v2-benchmark-regression-gate.mjs - benchmark dashboard:
scripts/isis/generate-v2-benchmark-dashboard.mjs - UX capability matrix:
docs/domains/isis/remediation-v2/ISIS_V2_UX_INTERACTION_MATRIX.json - primary UI surfaces under test:
apps/isis/web/src/pages/WorkflowDetailsPage.tsxapps/isis/web/src/pages/OutputsPage.tsxapps/isis/web/src/pages/job-submission-utils.ts
Deliverables#
- Completed UX benchmark study cycle and captured baseline + post-iteration metrics:
- baseline before iteration: required capability pass 53.33%, workflow pass 0.00%, taxonomy coverage 11.11%, missing capability buckets 14.
- after iteration: required capability pass 100.00%, workflow pass 100.00%, taxonomy coverage 100.00%, missing capability buckets 0.
- Implemented ergonomics iterations to close benchmark gaps:
WorkflowDetailsPageadvanced controls:Reference Set,Style Anchor,Pose Map,Depth Map,Segmentation Map,Mask Editor,Camera Path,Lens Profile,Temporal Lock.OutputsPagereview/distribution workbench:Timeline, inline<audio>audition,Engine Bundle+DCC Bundleexport controls, andConsistency Compareworkspace.job-submission-utils.tsexplicit cross-modality generation targets includingtext-to-audio,voice-synthesis,music-generation, andinpainting.
- Improved taxonomy coverage measurement quality:
- benchmark derived metric now supports semantic alias mapping between taxonomy categories and UX category labels to avoid brittle literal-name mismatch.
- Locked measurable UX ergonomics targets into regression baseline:
ux.requiredCapabilityPassRate >= 1ux.workflowPassRate >= 1ux.workflowsPassed >= 48ux.missingRequiredCapabilityCount <= 0ux.missingCapabilityBuckets <= 0ux.taxonomyCategoryCoverage >= 1
Verification Commands#
bash
pnpm --filter @isis/web exec vitest run src/pages/job-submission-utils.spec.ts --reporter=dot
pnpm --filter @isis/web exec vitest run src/pages/WorkflowDetailsPage.spec.tsx src/pages/OutputsPage.spec.tsx --reporter=dot
node scripts/isis/run-v2-ux-interaction-benchmark.mjs
node scripts/isis/generate-v2-benchmark-dashboard.mjs
node scripts/isis/validate-v2-benchmark-regression-gate.mjs
node scripts/isis/generate-remediation-backlog-v2.mjs
node scripts/isis/validate-v2-compliance-gate.mjs
Verification Notes#
job-submission-utils.spec.tspasses with the new cross-modality assertions.WorkflowDetailsPage.spec.tsxandOutputsPage.spec.tsxremain blocked by the pre-existing workspace package-resolution issue for@isis/client.- Benchmark study + dashboard generation + regression gate now pass with fully green UX ergonomics metrics.