Eve library

Isis Production Workflow Class Probes Runbook

Runbook

Revision 1

On this page

Last Updated: 2026-02-24
Scope: WS18-006 production verification probes for all critical workflow classes.

Purpose#

Provide deterministic probe coverage for every critical (riskBand=high) workflow class before release progression.

The workflow-class probe system includes:

  1. Generated critical-class probe manifest
  2. Manifest validation gate
  3. Runtime probe execution report against RunPod synthetic transaction status

Artifacts#

  • docs/domains/isis/remediation-v2/ISIS_V2_PRODUCTION_VERIFICATION_PROBES.json
  • docs/domains/isis/remediation-v2/ISIS_V2_PRODUCTION_VERIFICATION_PROBES.md

Generator#

bash
node scripts/isis/generate-v2-production-verification-probes.mjs

Validator#

bash
node scripts/isis/validate-v2-production-verification-probes.mjs

Probe Runner#

bash
scripts/isis/run_production_workflow_class_probes.sh

Default outputs:

  • tmp/isis-probes/production-workflow-class-probes-<timestamp>.json
  • tmp/isis-probes/production-workflow-class-probes-<timestamp>.md

Execution Modes#

Synthetic Mode (Deterministic Local Validation)#

bash
STRICT=true \
OPERATIONS_SOURCE=synthetic \
scripts/isis/run_production_workflow_class_probes.sh

API Snapshot Mode (Production/Staging)#

bash
STRICT=true \
OPERATIONS_SOURCE=api \
ISIS_API_BASE_URL="https://<isis-api-host>" \
ISIS_ADMIN_TOKEN="..." \
scripts/isis/run_production_workflow_class_probes.sh

File Mode (Captured Snapshot Replay)#

bash
STRICT=true \
OPERATIONS_SOURCE=file \
OPERATIONS_FILE=tmp/isis-release-gate/runpod-operations-<timestamp>.json \
scripts/isis/run_production_workflow_class_probes.sh

Pass Criteria#

  • Probe manifest coverage is present and valid.
  • Every critical workflow class probe maps to a probe family.
  • For each critical class, probe-family synthetic transaction status is pass.
  • Strict mode exits non-zero when any required probe check is not pass.
  • scripts/isis/evaluate-runpod-release-gate.mjs
  • scripts/isis/run_release_failure_gameday.sh
  • docs/domains/isis/remediation-v2/ISIS_V2_PHASED_ROLLOUT_STRATEGY.json
  • docs/domains/isis/remediation/ISIS_RELEASE_QUALITY_BAR.md