Eve library
ISIS v2 Social Cutdown Pack Regression Tests and Golden Datasets
Guide
Revision 1
On this page
Generated: 2026-08-02T19:12:24.243Z Checklist: MXA-0520 (ISIS2-00718) Asset
Family: social-cutdown-pack Phase: Phase 4 | Milestone: M3 Launch (2026-07-27
to 2026-10-30)
Objective#
Establish deterministic social-cutdown-pack golden datasets and regression
checks that validate typed workflow contracts, quality-gate stability, and
output-package contract compliance across all workflow variants.
Workflow Coverage#
Workflow
Regression Dataset Coverage
Regression Test Coverage
social-cutdown-pack-baseline
yes
yes
social-cutdown-pack-image-conditioned
yes
yes
social-cutdown-pack-control-conditioned
yes
yes
social-cutdown-pack-consistency-locked
yes
yes
Golden Case Coverage#
Case ID
Dataset Coverage
Test Coverage
golden-social-cutdown-pack-baseline-launch-hook
yes
yes
golden-social-cutdown-pack-image-conditioned-creator-adapt
yes
yes
golden-social-cutdown-pack-control-conditioned-overlay-locked
yes
yes
golden-social-cutdown-pack-consistency-locked-series-master
yes
yes
regression-social-cutdown-pack-quality-drift
yes
yes
regression-social-cutdown-pack-package-contract-miss
yes
yes
Output Contract Coverage#
Output Class
Dataset Coverage
preview_image
yes
source_frames
yes
metadata_manifest
yes
Manifest Artifact
Dataset Coverage
baseline/generation-metadata.json
yes
baseline/provenance.json
yes
baseline/package-manifest.json
yes
baseline/cutdown-plan.json
yes
baseline/delivery-manifest.json
yes
baseline/caption-safe-area-map.json
yes
baseline/checksums.sha256
yes
image-conditioned/generation-metadata.json
yes
image-conditioned/provenance.json
yes
image-conditioned/package-manifest.json
yes
image-conditioned/cutdown-plan.json
yes
image-conditioned/delivery-manifest.json
yes
image-conditioned/caption-safe-area-map.json
yes
image-conditioned/checksums.sha256
yes
control-conditioned/generation-metadata.json
yes
control-conditioned/provenance.json
yes
control-conditioned/package-manifest.json
yes
control-conditioned/cutdown-plan.json
yes
control-conditioned/delivery-manifest.json
yes
control-conditioned/caption-safe-area-map.json
yes
control-conditioned/checksums.sha256
yes
consistency-locked/generation-metadata.json
yes
consistency-locked/provenance.json
yes
consistency-locked/package-manifest.json
yes
consistency-locked/cutdown-plan.json
yes
consistency-locked/delivery-manifest.json
yes
consistency-locked/caption-safe-area-map.json
yes
consistency-locked/checksums.sha256
yes
consistency-locked/continuity-profile-locks.json
yes
consistency-locked/continuity-manifest.json
yes
Verification Commands#
pnpm --filter @isis/generation-api exec vitest run src/routes/social-cutdown-pack-regression-golden-dataset.spec.ts src/routes/social-cutdown-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
Acceptance Criteria#
Golden dataset includes deterministic approved cases for baseline,
image-conditioned, control-conditioned, and consistency-locked
social-cutdown-pack workflow variants.
Regression suite includes explicit drift scenarios for quality-threshold
failure and output-package contract non-compliance.
Regression execution validates typed social-cutdown-pack workflow request
contracts and deterministic replay stability semantics.
Suite-level reporting exposes expectation accuracy, replay stability ratio,
quality-gate acceptance ratio, and output-package compliance ratio.