Last Updated: 2026-02-24
Scope: WS18-006 production verification probes for all critical workflow
classes.
Purpose#
Provide deterministic probe coverage for every critical (riskBand=high)
workflow class before release progression.
The workflow-class probe system includes:
- Generated critical-class probe manifest
- Manifest validation gate
- Runtime probe execution report against RunPod synthetic transaction status
Artifacts#
docs/domains/isis/remediation-v2/ISIS_V2_PRODUCTION_VERIFICATION_PROBES.jsondocs/domains/isis/remediation-v2/ISIS_V2_PRODUCTION_VERIFICATION_PROBES.md
Generator#
bash
node scripts/isis/generate-v2-production-verification-probes.mjs
Validator#
bash
node scripts/isis/validate-v2-production-verification-probes.mjs
Probe Runner#
bash
scripts/isis/run_production_workflow_class_probes.sh
Default outputs:
tmp/isis-probes/production-workflow-class-probes-<timestamp>.jsontmp/isis-probes/production-workflow-class-probes-<timestamp>.md
Execution Modes#
Synthetic Mode (Deterministic Local Validation)#
bash
STRICT=true \
OPERATIONS_SOURCE=synthetic \
scripts/isis/run_production_workflow_class_probes.sh
API Snapshot Mode (Production/Staging)#
bash
STRICT=true \
OPERATIONS_SOURCE=api \
ISIS_API_BASE_URL="https://<isis-api-host>" \
ISIS_ADMIN_TOKEN="..." \
scripts/isis/run_production_workflow_class_probes.sh
File Mode (Captured Snapshot Replay)#
bash
STRICT=true \
OPERATIONS_SOURCE=file \
OPERATIONS_FILE=tmp/isis-release-gate/runpod-operations-<timestamp>.json \
scripts/isis/run_production_workflow_class_probes.sh
Pass Criteria#
- Probe manifest coverage is present and valid.
- Every critical workflow class probe maps to a probe family.
- For each critical class, probe-family synthetic transaction status is
pass. - Strict mode exits non-zero when any required probe check is not
pass.
Related Artifacts#
scripts/isis/evaluate-runpod-release-gate.mjsscripts/isis/run_release_failure_gameday.shdocs/domains/isis/remediation-v2/ISIS_V2_PHASED_ROLLOUT_STRATEGY.jsondocs/domains/isis/remediation/ISIS_RELEASE_QUALITY_BAR.md