Eve library

ISIS v2 WS13-007: Model Provenance and Licensing Metadata Enforcement

Guide

Revision 1

On this page

Scope#

WS13-007 implements model provenance and licensing metadata enforcement across job submission, output review, and parity validation surfaces.

The implementation adds deterministic policy checks for model attribution and license compliance, including strict/review/advisory enforcement, compliance signals, submit-time gating, and persisted output metadata dispositions.

Research and Existing Implementation Alignment#

Before implementation, the following existing patterns were analyzed and reused:

  • shared policy-engine patterns from:
    • content-governance-policy-utils.ts
    • artifact-integrity-utils.ts
    • abuse-controls-utils.ts
  • metadata merge/read conventions in OutputsPage for governance and integrity controls,
  • submit-time policy gating and metadata propagation patterns in JobSubmissionStudio,
  • parity-console execution model in OutputsParityPage.

This produced a utility-first implementation with policy normalization, structured findings, and consistent metadata persistence contracts.

Deliverables#

  1. Added shared model provenance/licensing policy utility:
  • apps/isis/web/src/security/model-provenance-licensing-utils.ts
    • policy defaults + normalization (strict/review/advisory),
    • list parsers and required-field parsing,
    • model/provenance/license metadata extraction from submission/output contexts,
    • deterministic evaluation report with structured signals,
    • output metadata merge/read helpers for reviewed disposition records.
  1. Added utility unit coverage:
  • apps/isis/web/src/security/model-provenance-licensing-utils.spec.ts
    • strict pass behavior for compliant metadata,
    • strict block behavior for missing license metadata,
    • review-mode downgrade behavior,
    • studio-form extraction coverage,
    • output metadata merge/read roundtrip coverage.
  1. Integrated submit-time enforcement in Job Submission Studio:
  • apps/isis/web/src/pages/JobSubmissionStudio.tsx
    • added model provenance/licensing policy controls and preview reporting UI,
    • enforced submit-time block/review acknowledgement behavior,
    • attached modelProvenanceLicensingPolicy and modelProvenanceLicensingEvaluation metadata to submitted requests.
  1. Integrated output-level enforcement and metadata persistence:
  • apps/isis/web/src/pages/OutputsPage.tsx
    • added output policy controls and evaluation table for model provenance and licensing checks,
    • added apply action to persist reviewed model provenance/licensing metadata disposition.
  1. Added parity-console coverage:
  • apps/isis/web/src/pages/OutputsParityPage.tsx
    • added evaluateModelProvenanceLicensing parity method coverage entry,
    • added parity action to evaluate selected output + provenance metadata under default model provenance policy.
  1. Expanded page-level tests (coverage authored, execution still baseline-blocked in this workspace):
  • apps/isis/web/src/pages/JobSubmissionStudio.spec.tsx
  • apps/isis/web/src/pages/OutputsPage.spec.tsx
  • apps/isis/web/src/pages/OutputsParityPage.spec.tsx

Verification Commands#

bash
pnpm --filter @isis/web exec vitest run src/security/model-provenance-licensing-utils.spec.ts src/security/abuse-controls-utils.spec.ts src/security/content-governance-policy-utils.spec.ts src/security/artifact-integrity-utils.spec.ts --reporter=dot
pnpm --filter @isis/web exec vitest run src/pages/JobSubmissionStudio.spec.tsx src/pages/OutputsPage.spec.tsx src/pages/OutputsParityPage.spec.tsx --reporter=dot
pnpm --filter @isis/web run typecheck
node scripts/isis/generate-remediation-backlog-v2.mjs
node scripts/isis/validate-v2-compliance-gate.mjs

Verification Notes#

  • Shared security utility suites pass, including new model-provenance-licensing-utils.spec.ts.
  • Page-level suites are still blocked by the pre-existing workspace @isis/client package-entry resolution issue.
  • Web typecheck remains red on known baseline issues unrelated to WS13-007 (RunPod fleet nullability, workflow result typing, and cross-package rootDir scope).