Eve library

ISIS v2 Audio SFX Pack Regression Tests and Golden Datasets

Guide

Revision 1

On this page

Generated: 2026-08-02T19:12:26.526Z Checklist: MXA-0538 (ISIS2-00736) Asset Family: audio-sfx-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Establish deterministic audio-sfx-pack golden datasets and regression checks that validate typed workflow contracts, quality-gate stability, and output-package contract compliance across all workflow variants.

Workflow Coverage#

Workflow Regression Dataset Coverage Regression Test Coverage
audio-sfx-pack-baseline yes yes
audio-sfx-pack-image-conditioned yes yes
audio-sfx-pack-control-conditioned yes yes
audio-sfx-pack-consistency-locked yes yes

Case Coverage#

Case ID Regression Dataset Coverage Regression Test Coverage
golden-audio-sfx-pack-baseline-hydraulic-door yes yes
golden-audio-sfx-pack-image-conditioned-ui-activation yes yes
golden-audio-sfx-pack-control-conditioned-creature-impact yes yes
golden-audio-sfx-pack-consistency-locked-cinematic-collapse yes yes
regression-audio-sfx-pack-quality-drift yes yes
regression-audio-sfx-pack-package-contract-miss yes yes

Output Contract Coverage#

Output Class Regression Dataset Coverage
audio_master yes
metadata_manifest yes
project_archive yes
Manifest Artifact Regression Dataset Coverage
baseline/generation-metadata.json yes
baseline/provenance.json yes
baseline/package-manifest.json yes
baseline/audio-master-manifest.json yes
baseline/loudness-report.json yes
baseline/dependency-lock.json yes
baseline/checksums.sha256 yes
image-conditioned/generation-metadata.json yes
image-conditioned/provenance.json yes
image-conditioned/package-manifest.json yes
image-conditioned/audio-master-manifest.json yes
image-conditioned/loudness-report.json yes
image-conditioned/dependency-lock.json yes
image-conditioned/checksums.sha256 yes
image-conditioned/reference-audio-conditioning.json yes
control-conditioned/generation-metadata.json yes
control-conditioned/provenance.json yes
control-conditioned/package-manifest.json yes
control-conditioned/audio-master-manifest.json yes
control-conditioned/loudness-report.json yes
control-conditioned/dependency-lock.json yes
control-conditioned/checksums.sha256 yes
control-conditioned/control-signal-map.json yes
consistency-locked/generation-metadata.json yes
consistency-locked/provenance.json yes
consistency-locked/package-manifest.json yes
consistency-locked/audio-master-manifest.json yes
consistency-locked/loudness-report.json yes
consistency-locked/dependency-lock.json yes
consistency-locked/checksums.sha256 yes
consistency-locked/continuity-profile-locks.json yes
consistency-locked/continuity-manifest.json yes

Verification#

  • pnpm --filter @isis/generation-api exec vitest run src/routes/audio-sfx-pack-regression-golden-dataset.spec.ts src/routes/audio-sfx-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • Golden dataset includes deterministic approved cases for baseline, image-conditioned, control-conditioned, and consistency-locked audio-sfx-pack workflow variants.
  • Regression suite includes explicit drift scenarios for quality-threshold failure and output-package contract non-compliance.
  • Regression execution validates typed audio-sfx-pack workflow request contracts and deterministic replay stability semantics.
  • Suite-level reporting exposes expectation accuracy, replay stability ratio, quality-gate acceptance ratio, and output-package compliance ratio.

References#

  • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
  • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_REQUIREMENTS_BRIEF.json
  • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_QUALITY_EVALUATOR_ACCEPTANCE_GATE.json
  • apps/isis/generation-api/src/routes/audio-sfx-pack-regression-golden-dataset.ts
  • apps/isis/generation-api/src/routes/audio-sfx-pack-regression-golden-dataset.spec.ts
  • apps/isis/generation-api/src/routes/audio-sfx-pack-quality-gate-utils.ts
  • apps/isis/generation-api/src/schemas/audio-sfx-pack.schema.ts
  • ISIS_TODOS_2.md