Eve library

ISIS v2 Environment Matte Painting Regression Tests and Golden Datasets

Guide

Revision 1

On this page

Generated: 2026-02-28T11:15:51.066Z Checklist: MXA-0160 (ISIS2-00358) Asset Family: environment-matte-painting Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Establish deterministic environment-matte-painting golden datasets and regression checks that validate typed workflow contracts, quality-gate stability, and output-package contract compliance across all workflow variants.

Workflow Coverage#

Workflow Regression Dataset Coverage Regression Test Coverage
environment-matte-painting-baseline yes yes
environment-matte-painting-image-conditioned yes yes
environment-matte-painting-control-conditioned yes yes
environment-matte-painting-consistency-locked yes yes

Golden/Regression Case Coverage#

Case ID Dataset Coverage Test Coverage
golden-environment-matte-painting-baseline-temperate-forest yes yes
golden-environment-matte-painting-image-conditioned-neon-district yes yes
golden-environment-matte-painting-control-conditioned-industrial-rift yes yes
golden-environment-matte-painting-consistency-locked-transit-hub yes yes
regression-environment-matte-painting-consistency-drift yes yes
regression-environment-matte-painting-package-contract-miss yes yes

Verification Commands#

  • pnpm --filter @isis/generation-api exec vitest run src/routes/environment-matte-painting-regression-golden-dataset.spec.ts src/routes/environment-matte-painting-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • Golden dataset includes deterministic approved cases for baseline, image-conditioned, control-conditioned, and consistency-locked workflow variants.
  • Regression suite includes explicit drift scenarios for quality-threshold failure and output-package contract non-compliance.
  • Regression execution validates typed workflow request contracts and deterministic replay stability semantics.
  • Suite-level reporting exposes expectation accuracy, replay stability ratio, quality-gate acceptance ratio, and output-package compliance ratio.

Traceability#

  • Checklist item: MXA-0160
  • Ticket key: ISIS2-00358
  • Upstream dependency: MXA-0159