Scope#
WS13-007 implements model provenance and licensing metadata enforcement across
job submission, output review, and parity validation surfaces.
The implementation adds deterministic policy checks for model attribution and license compliance, including strict/review/advisory enforcement, compliance signals, submit-time gating, and persisted output metadata dispositions.
Research and Existing Implementation Alignment#
Before implementation, the following existing patterns were analyzed and reused:
- shared policy-engine patterns from:
content-governance-policy-utils.tsartifact-integrity-utils.tsabuse-controls-utils.ts
- metadata merge/read conventions in
OutputsPagefor governance and integrity controls, - submit-time policy gating and metadata propagation patterns in
JobSubmissionStudio, - parity-console execution model in
OutputsParityPage.
This produced a utility-first implementation with policy normalization, structured findings, and consistent metadata persistence contracts.
Deliverables#
- Added shared model provenance/licensing policy utility:
apps/isis/web/src/security/model-provenance-licensing-utils.ts- policy defaults + normalization (
strict/review/advisory), - list parsers and required-field parsing,
- model/provenance/license metadata extraction from submission/output contexts,
- deterministic evaluation report with structured signals,
- output metadata merge/read helpers for reviewed disposition records.
- policy defaults + normalization (
- Added utility unit coverage:
apps/isis/web/src/security/model-provenance-licensing-utils.spec.ts- strict pass behavior for compliant metadata,
- strict block behavior for missing license metadata,
- review-mode downgrade behavior,
- studio-form extraction coverage,
- output metadata merge/read roundtrip coverage.
- Integrated submit-time enforcement in Job Submission Studio:
apps/isis/web/src/pages/JobSubmissionStudio.tsx- added model provenance/licensing policy controls and preview reporting UI,
- enforced submit-time block/review acknowledgement behavior,
- attached
modelProvenanceLicensingPolicyandmodelProvenanceLicensingEvaluationmetadata to submitted requests.
- Integrated output-level enforcement and metadata persistence:
apps/isis/web/src/pages/OutputsPage.tsx- added output policy controls and evaluation table for model provenance and licensing checks,
- added apply action to persist reviewed model provenance/licensing metadata disposition.
- Added parity-console coverage:
apps/isis/web/src/pages/OutputsParityPage.tsx- added
evaluateModelProvenanceLicensingparity method coverage entry, - added parity action to evaluate selected output + provenance metadata under default model provenance policy.
- added
- Expanded page-level tests (coverage authored, execution still baseline-blocked in this workspace):
apps/isis/web/src/pages/JobSubmissionStudio.spec.tsxapps/isis/web/src/pages/OutputsPage.spec.tsxapps/isis/web/src/pages/OutputsParityPage.spec.tsx
Verification Commands#
bash
pnpm --filter @isis/web exec vitest run src/security/model-provenance-licensing-utils.spec.ts src/security/abuse-controls-utils.spec.ts src/security/content-governance-policy-utils.spec.ts src/security/artifact-integrity-utils.spec.ts --reporter=dot
pnpm --filter @isis/web exec vitest run src/pages/JobSubmissionStudio.spec.tsx src/pages/OutputsPage.spec.tsx src/pages/OutputsParityPage.spec.tsx --reporter=dot
pnpm --filter @isis/web run typecheck
node scripts/isis/generate-remediation-backlog-v2.mjs
node scripts/isis/validate-v2-compliance-gate.mjs
Verification Notes#
- Shared security utility suites pass, including new
model-provenance-licensing-utils.spec.ts. - Page-level suites are still blocked by the pre-existing workspace
@isis/clientpackage-entry resolution issue. - Web typecheck remains red on known baseline issues unrelated to
WS13-007(RunPod fleet nullability, workflow result typing, and cross-packagerootDirscope).