Eve library

ISIS v2 Reference-Ensemble Animatic-Sequence Certification

Guide

Revision 1

On this page

Generated: 2026-08-02T11:40:02.840Z Checklist: MXB-0071 (ISIS2-00845) Consistency Strategy: reference-ensemble Target Class: animatic-sequence Release Gate: PASS

Workflow Coverage#

Workflow Registry Coverage Reference-Ensemble Support Workflow Path Output Profile
animatediff-controlnet yes yes video/animatediff-controlnet video-master-profile
lecture-scene yes yes video/lecture-scene video-master-profile
concept-explainer yes yes video/concept-explainer video-master-profile
guided-journey yes yes video/guided-journey video-master-profile

Threshold Policy#

Metric Rule
element_silhouette_iou >= 0.8
temporal_flicker_rate <= 0.05
motion_vector_drift <= 0.08
story_clarity_score >= 0.85
panel_transition_consistency >= 0.8
camera_intent_alignment >= 0.8
seed_replay_hash_match >= 0.98

Benchmark Dataset Summary#

  • Dataset ID: reference-ensemble-animatic-sequence-benchmark-v1
  • Cases: 8
  • Pass Rate: 1
  • Missing Workflow Coverage: none

Regression Suite#

Scenario Expected Gate Actual Gate Assertion
baseline-dataset-pass pass pass pass
drift-injected-motion-vector-failure fail fail pass
drift-injected-seed-replay-hash-miss fail fail pass
regression-missing-workflow-coverage fail fail pass
regression-strategy-mapping-missing fail fail pass

Acceptance Criteria#

  • Benchmark dataset covers all required animatic-sequence workflows that must support reference-ensemble.
  • Pass/fail threshold policy is explicit for silhouette continuity, temporal flicker rate, motion-vector drift, story clarity, panel-transition consistency, camera-intent alignment, and seed replay hash stability.
  • Regression suite includes positive and negative scenarios and proves gate behavior for drift and coverage regressions.
  • Release gate returns PASS only when dataset, workflow coverage, and regression assertions all succeed.

Traceability#

  • Checklist item: MXB-0071
  • Ticket key: ISIS2-00845
  • Required consistency dimensions: color-script, identity, wardrobe