Eve library

ISIS v2 WS16-001: Docs Claims Reconciliation and Unsupported Claim Marking

Guide

Revision 1

On this page

Scope#

WS16-001 reconciles ISIS documentation claims against implemented capabilities and marks unsupported claims explicitly.

This work establishes a deterministic claim-truth workflow for ISIS docs:

  • canonical claim registry source;
  • generated reconciliation report (SUPPORTED/PARTIAL/UNSUPPORTED);
  • explicit unsupported markers in source docs where claims exceed current implementation evidence.

Research and Existing Implementation Alignment#

Before implementation, existing ISIS deterministic artifact and gate patterns were reviewed:

  • remediation evidence and generated artifact patterns:
    • scripts/isis/generate-remediation-backlog-v2.mjs
    • scripts/isis/validate-v2-compliance-gate.mjs
  • existing WS15 implementation docs used as support-evidence anchors:
    • ISIS_V2_CONTRACT_TESTS_FOR_SCHEMA_COMPATIBILITY_ACROSS_ALL_SERVICES_AND_SDK.md
    • ISIS_V2_UI_E2E_JOURNEYS_FOR_CREATOR_REVIEWER_OPERATOR_PERSONAS.md
    • ISIS_V2_CROSS_BROWSER_AND_RESPONSIVE_REGRESSION_SUITE_FOR_CRITICAL_CREATIVE_WORKFLOWS.md
    • ISIS_V2_ACCESSIBILITY_TEST_GATE_KEYBOARD_SCREEN_READER_CONTRAST_MOTION_SENSITIVITY.md
    • ISIS_V2_CERTIFICATION_BADGE_GENERATION_AND_PUBLICATION_FOR_EACH_CLOSED_WORKFLOW_FAMILY.md
  • top-level ISIS docs containing broad capability claims:
    • docs/domains/isis/README.md
    • docs/domains/isis/features.md

Deliverables#

  1. Added canonical claim registry source
  • docs/domains/isis/remediation-v2/ISIS_V2_DOC_CLAIMS_SOURCE.json

Registry includes:

  • source document references;
  • claim statements;
  • required artifact proofs;
  • required checklist IDs.
  1. Added deterministic reconciliation generator + validator
  • scripts/isis/reconcile-v2-doc-claims.mjs
  • scripts/isis/validate-v2-doc-claims-reconciliation.mjs

Implemented:

  • checklist status extraction from ISIS_TODOS_2.md;
  • per-claim artifact/checklist verification;
  • normalized claim status classification:
    • [SUPPORTED],
    • [PARTIAL],
    • [UNSUPPORTED];
  • generated machine-readable + human-readable reconciliation outputs.
  1. Published reconciliation outputs
  • docs/domains/isis/remediation-v2/ISIS_V2_DOC_CLAIMS_RECONCILIATION.json
  • docs/domains/isis/remediation-v2/ISIS_V2_DOCS_CLAIMS_RECONCILIATION.md

The report explicitly lists unsupported claims and missing requirements.

  1. Marked unsupported claims clearly in source docs
  • docs/domains/isis/features.md
    • [UNSUPPORTED] Git-Like Branching
    • [UNSUPPORTED] Comfy Cloud Native
  • docs/domains/isis/README.md
    • added "Documentation Claim Status" section linking reconciliation report.

Verification Commands#

bash
node scripts/isis/reconcile-v2-doc-claims.mjs
node scripts/isis/validate-v2-doc-claims-reconciliation.mjs
node scripts/isis/generate-remediation-backlog-v2.mjs
node scripts/isis/validate-v2-compliance-gate.mjs

Verification Notes#

  • Reconciliation results are deterministic and traceable to artifact existence plus checklist state.
  • Unsupported claims are no longer implicit; they are explicitly marked in both source docs and generated reconciliation outputs.