# ISIS v2 Architecture Kitbash Pack Regression Tests and Golden Datasets

Generated: 2026-08-02T14:22:05.853Z Checklist: `MXA-0196` (ISIS2-00394) Asset
Family: `architecture-kitbash-pack` Phase: Phase 4 | Milestone: M3 Launch
(2026-07-27 to 2026-10-30)

## Objective

Establish deterministic architecture-kitbash-pack golden datasets and regression
checks that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.

## Workflow Coverage

| Workflow                                        | Regression Dataset Coverage | Regression Test Coverage |
| ----------------------------------------------- | --------------------------- | ------------------------ |
| `architecture-kitbash-pack-baseline`            | yes                         | yes                      |
| `architecture-kitbash-pack-image-conditioned`   | yes                         | yes                      |
| `architecture-kitbash-pack-control-conditioned` | yes                         | yes                      |
| `architecture-kitbash-pack-consistency-locked`  | yes                         | yes                      |

## Golden/Regression Case Coverage

| Case ID                                                                | Dataset Coverage | Test Coverage |
| ---------------------------------------------------------------------- | ---------------- | ------------- |
| `golden-architecture-kitbash-pack-baseline-temperate-forest`           | yes              | yes           |
| `golden-architecture-kitbash-pack-image-conditioned-neon-district`     | yes              | yes           |
| `golden-architecture-kitbash-pack-control-conditioned-industrial-rift` | yes              | yes           |
| `golden-architecture-kitbash-pack-consistency-locked-transit-hub`      | yes              | yes           |
| `regression-architecture-kitbash-pack-consistency-drift`               | yes              | yes           |
| `regression-architecture-kitbash-pack-package-contract-miss`           | yes              | yes           |

## Verification Commands

- `pnpm --filter @isis/generation-api exec vitest run src/routes/architecture-kitbash-pack-regression-golden-dataset.spec.ts src/routes/architecture-kitbash-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts`

## Acceptance Criteria

- Golden dataset includes deterministic approved cases for baseline,
  image-conditioned, control-conditioned, and consistency-locked workflow
  variants.
- Regression suite includes explicit drift scenarios for quality-threshold
  failure and output-package contract non-compliance.
- Regression execution validates typed workflow request contracts and
  deterministic replay stability semantics.
- Suite-level reporting exposes expectation accuracy, replay stability ratio,
  quality-gate acceptance ratio, and output-package compliance ratio.

## Traceability

- Checklist item: `MXA-0196`
- Ticket key: `ISIS2-00394`
- Upstream dependency: `MXA-0195`
