Date: 2026-02-22
Checklist Item: OPS-005
Ticket: ISIS-0240
Scope#
Compliance verification coverage for Isis output/provenance/model data hygiene:
- Output retention and expiration enforcement.
- Provenance referential integrity.
- Model artifact retention cleanup and delete-audit integrity.
Evidence Matrix#
| Requirement | Evidence | Status |
|---|---|---|
| Retention/deletion compliance verification is automated | scripts/isis/verify_data_retention_compliance.sh executes PostgreSQL compliance checks and emits structured JSON reports with thresholds, metrics, and failure reasons. |
Pass |
| Output retention compliance is explicitly validated | Same script checks pending-expired outputs (status not expired/deleted while expires_at < NOW()) and retention policy presence gates for retention_policies. |
Pass |
| Provenance integrity compliance is explicitly validated | Same script checks orphan provenance rows and broken outputs.provenance_id references to ensure lineage/provenance consistency required for compliance reporting. |
Pass |
| Model artifact retention/deletion compliance is explicitly validated | Same script validates stale abandoned uploads, soft-delete consistency (deleted_at + is_active), model delete audit coverage (model_registry_audit_log), and abandoned-upload cleanup storage-deletion evidence. |
Pass |
| Operational runbook exists for remediation workflow | docs/domains/isis/runbooks/data-retention-compliance.md documents prerequisites, execution, thresholds, remediation paths, and recommended cadence for production/staging compliance operation. |
Pass |
| Core retention/deletion implementation is traceable | Existing implementation artifacts referenced by runbook/certification: apps/isis/output-registry/src/services/output.service.ts retention + provenance operations and apps/isis/generation-api/src/services/model.service.ts abandoned cleanup flow. |
Pass |
Reproduction Commands#
bash
bash -n scripts/isis/verify_data_retention_compliance.sh
STRICT=true \
ISIS_DATABASE_URL="postgres://..." \
scripts/isis/verify_data_retention_compliance.sh