Eve library

ISIS v2 JSON-MANIFEST Generation and Packaging Tests

Guide

Revision 1

On this page

Generated: 2026-03-06T09:50:54.721Z Checklist: MXD-0062 (ISIS2-01252) Format: json-manifest

Objective#

Aggregate generation and packaging test coverage for standalone JSON manifest outputs across all workflow families whose output-package contracts explicitly emit manifest JSON artifacts.

Family Coverage#

Asset Family Output Classes Workflow Coverage Package Manifest Checksums Package Drift Case
animatic-shot-set metadata_manifest complete yes yes yes
architecture-kitbash-pack metadata_manifest complete yes yes yes
audio-sfx-pack metadata_manifest complete yes yes yes
character-concept-art metadata_manifest complete yes yes yes
character-costume-variant-pack metadata_manifest complete yes yes yes
character-expression-sheet metadata_manifest complete yes yes yes
character-prop-interaction-sheet metadata_manifest complete yes yes yes
character-turnaround-sheet metadata_manifest complete yes yes yes
cinematic-shot-sequence metadata_manifest complete yes yes yes
creature-concept-art metadata_manifest complete yes yes yes
decal-pack metadata_manifest complete yes yes yes
environment-concept-art metadata_manifest complete yes yes yes
environment-matte-painting metadata_manifest complete yes yes yes
environment-tileset-pack metadata_manifest complete yes yes yes
foliage-pack metadata_manifest complete yes yes yes
hud-element-pack metadata_manifest complete yes yes yes
interior-scene-pack metadata_manifest complete yes yes yes
marketing-key-art-pack metadata_manifest complete yes yes yes
material-pbr-pack metadata_manifest complete yes yes yes
music-cue-pack metadata_manifest complete yes yes yes
npc-crowd-variation-pack metadata_manifest complete yes yes yes
prop-pack-general metadata_manifest complete yes yes yes
sky-atmosphere-pack metadata_manifest complete yes yes yes
social-cutdown-pack metadata_manifest complete yes yes yes
storyboard-frame-set metadata_manifest complete yes yes yes
terrain-heightmap-pack metadata_manifest complete yes yes yes
ui-icon-pack metadata_manifest complete yes yes yes
vehicle-exterior-pack metadata_manifest complete yes yes yes
vehicle-interior-pack metadata_manifest complete yes yes yes
vfx-element-pack metadata_manifest complete yes yes yes
voice-line-pack metadata_manifest complete yes yes yes
weapon-pack metadata_manifest complete yes yes yes

Verification Commands#

  • node scripts/isis/validate-v2-json-manifest-generation-packaging-tests.mjs
  • pnpm --filter @isis/generation-api exec vitest run src/routes/animatic-shot-set-regression-golden-dataset.spec.ts src/routes/animatic-shot-set-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/architecture-kitbash-pack-regression-golden-dataset.spec.ts src/routes/architecture-kitbash-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/audio-sfx-pack-regression-golden-dataset.spec.ts src/routes/audio-sfx-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/character-concept-art-regression-golden-dataset.spec.ts src/routes/character-concept-art-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/character-costume-variant-pack-regression-golden-dataset.spec.ts src/routes/character-costume-variant-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/character-expression-sheet-regression-golden-dataset.spec.ts src/routes/character-expression-sheet-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/character-prop-interaction-sheet-regression-golden-dataset.spec.ts src/routes/character-prop-interaction-sheet-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/character-turnaround-sheet-regression-golden-dataset.spec.ts src/routes/character-turnaround-sheet-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/cinematic-shot-sequence-regression-golden-dataset.spec.ts src/routes/cinematic-shot-sequence-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/creature-concept-art-regression-golden-dataset.spec.ts src/routes/creature-concept-art-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/decal-pack-regression-golden-dataset.spec.ts src/routes/decal-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/environment-concept-art-regression-golden-dataset.spec.ts src/routes/environment-concept-art-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/environment-matte-painting-regression-golden-dataset.spec.ts src/routes/environment-matte-painting-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/environment-tileset-pack-regression-golden-dataset.spec.ts src/routes/environment-tileset-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/foliage-pack-regression-golden-dataset.spec.ts src/routes/foliage-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/hud-element-pack-regression-golden-dataset.spec.ts src/routes/hud-element-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/interior-scene-pack-regression-golden-dataset.spec.ts src/routes/interior-scene-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/marketing-key-art-pack-regression-golden-dataset.spec.ts src/routes/marketing-key-art-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/material-pbr-pack-regression-golden-dataset.spec.ts src/routes/material-pbr-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/music-cue-pack-regression-golden-dataset.spec.ts src/routes/music-cue-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/npc-crowd-variation-pack-regression-golden-dataset.spec.ts src/routes/npc-crowd-variation-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/prop-pack-general-regression-golden-dataset.spec.ts src/routes/prop-pack-general-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/sky-atmosphere-pack-regression-golden-dataset.spec.ts src/routes/sky-atmosphere-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/social-cutdown-pack-regression-golden-dataset.spec.ts src/routes/social-cutdown-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/storyboard-frame-set-regression-golden-dataset.spec.ts src/routes/storyboard-frame-set-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/terrain-heightmap-pack-regression-golden-dataset.spec.ts src/routes/terrain-heightmap-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/ui-icon-pack-regression-golden-dataset.spec.ts src/routes/ui-icon-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/vehicle-exterior-pack-regression-golden-dataset.spec.ts src/routes/vehicle-exterior-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/vehicle-interior-pack-regression-golden-dataset.spec.ts src/routes/vehicle-interior-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/vfx-element-pack-regression-golden-dataset.spec.ts src/routes/vfx-element-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/voice-line-pack-regression-golden-dataset.spec.ts src/routes/voice-line-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts
  • pnpm --filter @isis/generation-api exec vitest run src/routes/weapon-pack-regression-golden-dataset.spec.ts src/routes/weapon-pack-quality-gate-utils.spec.ts src/routes/workflows.spec.ts src/routes/jobs.spec.ts

Acceptance Criteria#

  • Every JSON-manifest-applicable family is backed by a regression or golden-dataset report with complete workflow coverage.
  • Family regression coverage explicitly includes the JSON manifest output classes defined by each family output-package contract.
  • Family regression coverage verifies package-manifest and checksum artifacts and includes a package-contract drift case.
  • Aggregate JSON manifest reporting exposes full family coverage without gaps in regression-command traceability.

Traceability#

  • Checklist item: MXD-0062
  • Ticket key: ISIS2-01252
  • Source references:
    • docs/domains/isis/remediation-v2/ISIS_REMEDIATION_V2_TICKETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_JSON_MANIFEST_OUTPUT_SCHEMA_METADATA_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ANIMATIC_SHOT_SET_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ANIMATIC_SHOT_SET_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ARCHITECTURE_KITBASH_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ARCHITECTURE_KITBASH_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_AUDIO_SFX_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_CONCEPT_ART_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_CONCEPT_ART_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_COSTUME_VARIANT_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_COSTUME_VARIANT_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_EXPRESSION_SHEET_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_EXPRESSION_SHEET_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_PROP_INTERACTION_SHEET_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_PROP_INTERACTION_SHEET_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_TURNAROUND_SHEET_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CHARACTER_TURNAROUND_SHEET_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CINEMATIC_SHOT_SEQUENCE_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CINEMATIC_SHOT_SEQUENCE_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CREATURE_CONCEPT_ART_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_CREATURE_CONCEPT_ART_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_DECAL_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_DECAL_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ENVIRONMENT_CONCEPT_ART_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ENVIRONMENT_CONCEPT_ART_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ENVIRONMENT_MATTE_PAINTING_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ENVIRONMENT_MATTE_PAINTING_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ENVIRONMENT_TILESET_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_ENVIRONMENT_TILESET_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_FOLIAGE_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_FOLIAGE_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_HUD_ELEMENT_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_HUD_ELEMENT_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_INTERIOR_SCENE_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_INTERIOR_SCENE_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MARKETING_KEY_ART_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MARKETING_KEY_ART_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MATERIAL_PBR_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MATERIAL_PBR_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MUSIC_CUE_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_MUSIC_CUE_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_NPC_CROWD_VARIATION_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_NPC_CROWD_VARIATION_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_PROP_PACK_GENERAL_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_PROP_PACK_GENERAL_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_SKY_ATMOSPHERE_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_SKY_ATMOSPHERE_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_SOCIAL_CUTDOWN_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_SOCIAL_CUTDOWN_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_STORYBOARD_FRAME_SET_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_STORYBOARD_FRAME_SET_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_TERRAIN_HEIGHTMAP_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_TERRAIN_HEIGHTMAP_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_UI_ICON_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_UI_ICON_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VEHICLE_EXTERIOR_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VEHICLE_EXTERIOR_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VEHICLE_INTERIOR_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VEHICLE_INTERIOR_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VFX_ELEMENT_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VFX_ELEMENT_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VOICE_LINE_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_VOICE_LINE_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • docs/domains/isis/remediation-v2/ISIS_V2_WEAPON_PACK_OUTPUT_PACKAGE_CONTRACT.json
    • docs/domains/isis/remediation-v2/ISIS_V2_WEAPON_PACK_REGRESSION_TESTS_GOLDEN_DATASETS.json
    • ISIS_TODOS_2.md