Eve library

GATE-003 Certification: No Simulated Output Path in Production

Guide

Revision 1

On this page

Date: 2026-02-22
Checklist Item: GATE-003
Ticket: ISIS-0253

Scope#

Certify that simulated output generation paths are fail-closed in production and cannot be reached when real ComfyUI execution is unavailable.

Evidence Matrix#

Requirement Evidence Status
Production runtime blocks simulated execution fallback apps/isis/generation-api/src/workflows/executor.ts explicitly throws WORKFLOW_INCOMPATIBLE in production when ComfyUI is unavailable, preventing fallback to simulatedExecution (Incompatible workflow runtime: simulated output URL generation is disabled in production when ComfyUI is unavailable.). Pass
Production fail-closed behavior is validated by automated tests apps/isis/generation-api/src/workflows/executor.spec.ts test fails closed in production when execution would require simulated placeholder output URLs passed; it sets NODE_ENV=production + DISABLE_COMFYUI_SERVICE=true and verifies execution fails with WORKFLOW_INCOMPATIBLE and the production guard message. Pass
Unresolved workflow path is fail-closed in production apps/isis/generation-api/src/workflows/executor.spec.ts test fails closed with explicit production guard context when unresolved workflow occurs passed; it verifies production mode emits a fail-closed unresolved-workflow error context rather than permitting unsafe fallback behavior. Pass

Reproduction Commands#

bash
pnpm --filter @isis/generation-api exec vitest run src/workflows/executor.spec.ts -t "(fails closed with explicit production guard context when unresolved workflow occurs|fails closed in production when execution would require simulated placeholder output URLs)"