Eve library
ISIS v2 Audio SFX Pack Regression Tests and Golden Datasets
Guide
Revision 1
On this page
Generated: 2026-08-02T19:12:26.526Z Checklist: MXA-0538 (ISIS2-00736) Asset
Family: audio-sfx-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to
2026-10-30)
Objective#
Establish deterministic audio-sfx-pack golden datasets and regression checks
that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.
Workflow Coverage#
Workflow
Regression Dataset Coverage
Regression Test Coverage
audio-sfx-pack-baseline
yes
yes
audio-sfx-pack-image-conditioned
yes
yes
audio-sfx-pack-control-conditioned
yes
yes
audio-sfx-pack-consistency-locked
yes
yes
Case Coverage#
Case ID
Regression Dataset Coverage
Regression Test Coverage
golden-audio-sfx-pack-baseline-hydraulic-door
yes
yes
golden-audio-sfx-pack-image-conditioned-ui-activation
yes
yes
golden-audio-sfx-pack-control-conditioned-creature-impact
yes
yes
golden-audio-sfx-pack-consistency-locked-cinematic-collapse
yes
yes
regression-audio-sfx-pack-quality-drift
yes
yes
regression-audio-sfx-pack-package-contract-miss
yes
yes
Output Contract Coverage#
Output Class
Regression Dataset Coverage
audio_master
yes
metadata_manifest
yes
project_archive
yes
Manifest Artifact
Regression Dataset Coverage
baseline/generation-metadata.json
yes
baseline/provenance.json
yes
baseline/package-manifest.json
yes
baseline/audio-master-manifest.json
yes
baseline/loudness-report.json
yes
baseline/dependency-lock.json
yes
baseline/checksums.sha256
yes
image-conditioned/generation-metadata.json
yes
image-conditioned/provenance.json
yes
image-conditioned/package-manifest.json
yes
image-conditioned/audio-master-manifest.json
yes
image-conditioned/loudness-report.json
yes
image-conditioned/dependency-lock.json
yes
image-conditioned/checksums.sha256
yes
image-conditioned/reference-audio-conditioning.json
yes
control-conditioned/generation-metadata.json
yes
control-conditioned/provenance.json
yes
control-conditioned/package-manifest.json
yes
control-conditioned/audio-master-manifest.json
yes
control-conditioned/loudness-report.json
yes
control-conditioned/dependency-lock.json
yes
control-conditioned/checksums.sha256
yes
control-conditioned/control-signal-map.json
yes
consistency-locked/generation-metadata.json
yes
consistency-locked/provenance.json
yes
consistency-locked/package-manifest.json
yes
consistency-locked/audio-master-manifest.json
yes
consistency-locked/loudness-report.json
yes
consistency-locked/dependency-lock.json
yes
consistency-locked/checksums.sha256
yes
consistency-locked/continuity-profile-locks.json
yes
consistency-locked/continuity-manifest.json
yes
Verification#
pnpm --filter @isis/generation-api exec vitest run src/routes/audio-sfx-pack-regression-golden-dataset.spec.ts src/routes/audio-sfx-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
Acceptance Criteria#
Golden dataset includes deterministic approved cases for baseline,
image-conditioned, control-conditioned, and consistency-locked audio-sfx-pack
workflow variants.
Regression suite includes explicit drift scenarios for quality-threshold
failure and output-package contract non-compliance.
Regression execution validates typed audio-sfx-pack workflow request contracts
and deterministic replay stability semantics.
Suite-level reporting exposes expectation accuracy, replay stability ratio,
quality-gate acceptance ratio, and output-package compliance ratio.
References#
docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_REQUIREMENTS_BRIEF.json
docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_QUALITY_EVALUATOR_ACCEPTANCE_GATE.json
apps/isis/generation-api/src/routes/audio-sfx-pack-regression-golden-dataset.ts
apps/isis/generation-api/src/routes/audio-sfx-pack-regression-golden-dataset.spec.ts
apps/isis/generation-api/src/routes/audio-sfx-pack-quality-gate-utils.ts
apps/isis/generation-api/src/schemas/audio-sfx-pack.schema.ts
ISIS_TODOS_2.md