Eve library

ISIS v2 Social Cutdown Pack Quality Evaluator and Acceptance Gate

Guide

Revision 1

On this page

Generated: 2026-08-02T19:12:24.175Z Checklist: MXA-0519 (ISIS2-00717) Asset Family: social-cutdown-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27 to 2026-10-30)

Objective#

Deliver deterministic social-cutdown-pack quality evaluation using narrative-goal alignment, caption-safe-area compliance, continuity-lock adherence, and style-lock adherence metrics with threshold-based acceptance gating in workflow execution APIs and auditable diagnostics.

Workflow Coverage#

Workflow Quality Utils Coverage Jobs Strategy Coverage Workflow Surface Coverage
social-cutdown-pack-baseline yes yes no
social-cutdown-pack-image-conditioned yes yes no
social-cutdown-pack-control-conditioned yes yes yes
social-cutdown-pack-consistency-locked yes yes yes

Quality Environment Coverage#

Environment Key Quality Utils Coverage Jobs Strategy Coverage
ISIS_SOCIAL_CUTDOWN_PACK_QUALITY_GATE_ENABLED yes yes
ISIS_SOCIAL_CUTDOWN_PACK_MIN_QUALITY_SCORE yes yes
ISIS_SOCIAL_CUTDOWN_PACK_QUALITY_GATE_RETRY_AFTER_SECONDS yes yes
ISIS_SOCIAL_CUTDOWN_PACK_NARRATIVE_GOAL_ALIGNMENT_SCORE_MIN yes yes
ISIS_SOCIAL_CUTDOWN_PACK_CAPTION_SAFE_AREA_COMPLIANCE_SCORE_MIN yes yes
ISIS_SOCIAL_CUTDOWN_PACK_CONTINUITY_LOCK_ADHERENCE_SCORE_MIN yes yes
ISIS_SOCIAL_CUTDOWN_PACK_STYLE_LOCK_ADHERENCE_SCORE_MIN yes yes

Verification#

  • pnpm --filter @isis/generation-api exec vitest run src/routes/social-cutdown-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • social-cutdown-pack workflow variants evaluate narrative-goal alignment, caption-safe-area compliance, continuity-lock adherence, and style-lock adherence deterministically.
  • Quality threshold violations enforce acceptance-gate rejection before dispatch with explicit response code and retry metadata.
  • Workflow run responses and metadata persist quality score and gate-status diagnostics for operator visibility and downstream auditing.
  • Provider compatibility diagnostics expose social-cutdown-pack quality-gate policy metadata and environment-key governance coverage.

References#

  • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
  • docs/domains/isis/remediation-v2/ISIS_V2_SOCIAL_CUTDOWN_PACK_REQUIREMENTS_BRIEF.json
  • docs/domains/isis/remediation-v2/ISIS_V2_SOCIAL_CUTDOWN_PACK_COST_ESTIMATION_BUDGET_GUARDRAILS.json
  • apps/isis/generation-api/src/routes/workflows.ts
  • apps/isis/generation-api/src/routes/workflows.spec.ts
  • apps/isis/generation-api/src/routes/jobs.ts
  • apps/isis/generation-api/src/routes/jobs.spec.ts
  • apps/isis/generation-api/src/routes/social-cutdown-pack-quality-gate-utils.ts
  • apps/isis/generation-api/src/routes/social-cutdown-pack-quality-gate-utils.spec.ts
  • ISIS_TODOS_2.md