Date: 2026-02-22
Checklist Item: GATE-003
Ticket: ISIS-0253
Scope#
Certify that simulated output generation paths are fail-closed in production and cannot be reached when real ComfyUI execution is unavailable.
Evidence Matrix#
| Requirement | Evidence | Status |
|---|---|---|
| Production runtime blocks simulated execution fallback | apps/isis/generation-api/src/workflows/executor.ts explicitly throws WORKFLOW_INCOMPATIBLE in production when ComfyUI is unavailable, preventing fallback to simulatedExecution (Incompatible workflow runtime: simulated output URL generation is disabled in production when ComfyUI is unavailable.). |
Pass |
| Production fail-closed behavior is validated by automated tests | apps/isis/generation-api/src/workflows/executor.spec.ts test fails closed in production when execution would require simulated placeholder output URLs passed; it sets NODE_ENV=production + DISABLE_COMFYUI_SERVICE=true and verifies execution fails with WORKFLOW_INCOMPATIBLE and the production guard message. |
Pass |
| Unresolved workflow path is fail-closed in production | apps/isis/generation-api/src/workflows/executor.spec.ts test fails closed with explicit production guard context when unresolved workflow occurs passed; it verifies production mode emits a fail-closed unresolved-workflow error context rather than permitting unsafe fallback behavior. |
Pass |
Reproduction Commands#
bash
pnpm --filter @isis/generation-api exec vitest run src/workflows/executor.spec.ts -t "(fails closed with explicit production guard context when unresolved workflow occurs|fails closed in production when execution would require simulated placeholder output URLs)"