Eve library

ISIS v2 Material PBR Pack Regression Tests and Golden Datasets

Guide

Revision 1

On this page

Generated: 2026-08-02T16:03:35.372Z Checklist: MXA-0340 (ISIS2-00538) Asset Family: material-pbr-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Establish deterministic material-pbr-pack golden datasets and regression checks that validate typed workflow contracts, quality-gate stability, and output-package contract compliance across all workflow variants.

Workflow Coverage#

Workflow Regression Dataset Coverage Regression Test Coverage
material-pbr-pack-baseline yes yes
material-pbr-pack-image-conditioned yes yes
material-pbr-pack-control-conditioned yes yes
material-pbr-pack-consistency-locked yes yes

Golden Case Coverage#

Case ID Dataset Coverage Test Coverage
golden-material-pbr-pack-baseline-brushed-steel-panel yes yes
golden-material-pbr-pack-image-conditioned-aged-oak yes yes
golden-material-pbr-pack-control-conditioned-carbon-composite yes yes
golden-material-pbr-pack-consistency-locked-brushed-metal yes yes
regression-material-pbr-pack-quality-drift yes yes
regression-material-pbr-pack-package-contract-miss yes yes

Output Contract Coverage#

Output Class Dataset Coverage
preview_image yes
source_frames yes
metadata_manifest yes
Manifest Artifact Dataset Coverage
baseline/generation-metadata.json yes
baseline/provenance.json yes
baseline/package-manifest.json yes
baseline/material-spec-sheet.json yes
baseline/channel-pack-spec.json yes
baseline/checksums.sha256 yes
consistency-locked/material-spec-sheet.json yes
consistency-locked/channel-pack-spec.json yes
consistency-locked/continuity-profile-locks.json yes
consistency-locked/continuity-manifest.json yes
consistency-locked/checksums.sha256 yes

Verification Commands#

  • pnpm --filter @isis/generation-api exec vitest run src/routes/material-pbr-pack-regression-golden-dataset.spec.ts src/routes/material-pbr-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • Golden dataset includes deterministic approved cases for baseline, image-conditioned, control-conditioned, and consistency-locked material-pbr-pack workflow variants.
  • Regression suite includes explicit drift scenarios for quality-threshold failure and output-package contract non-compliance.
  • Regression execution validates typed material-pbr-pack workflow request contracts and deterministic replay stability semantics.
  • Suite-level reporting exposes expectation accuracy, replay stability ratio, quality-gate acceptance ratio, and output-package compliance ratio.