Recovered read-only on 2026-09-24 from 204.168.220.77:/tmp/claude-0/-root-workspace-oshun-strong-verify-codex/f657ce3c-2bd3-4b1b-86dd-539d18a9385e/scratchpad. Full logs retained privately at /mnt/volume300/oshun-platform/migrations/eve-content-839c7690/recovery-fixes-20260923/scorecard-retained-20260924. Hashes identify exact historical stdout, not a trusted current CI receipt. No live model evaluation was rerun for this correction. A failing eval remains failing even if a narrower advisory selection reports a passing test process. Tables below are deterministic counts of the exact progress rows; labels are the runner labels observed in each log.
This record supports the e77b0185 restamp measurements. The retained 13-case subset has 6/39 successful runs on new bytes, not the originally reported 7/39, and 8/39 at HEAD; 19 perfect cases contribute 57 successes to the complete family’s 63/96 total. It does not resolve the separate task review about preserving context in long threads or the integration test setup. Those implementation findings remain on R05.8. The family and 13-case control eval processes failed; the k=10/k=20 advisory selections passed their process gate while still having imperfect measured runs. Neither result proves the absence of a regression.
r058-wbw-eval.log#
SHA-256 of retained full log: 43754920b80443fff26ff99aa0ae978792e9b2d367ed8d67c434e8b1eedf5f54. Exact per-case progress rows and summary/test-status lines, omitting repeated assertion details:
[PASS 3/3] family-wbw-held-create
[ADVISORY PASS 3/3] builder-wbw-log-natural
[ADVISORY PASS 3/3] builder-wbw-file-issue
[ADVISORY FLAKY/FAIL 2/3] builder-wbw-capture-idea
[PASS 3/3] family-wbw-no-capability
[ADVISORY PASS 3/3] builder-wbw-draft-direct
[ADVISORY PASS 3/3] builder-wbw-park-listed
[ADVISORY PASS 3/3] builder-wbw-transition-listed
[ADVISORY PASS 3/3] builder-wbw-priority-listed
[ADVISORY PASS 3/3] builder-adv-self-accept
[ADVISORY PASS 3/3] builder-wbw-adr-export
[ADVISORY PASS 3/3] builder-adv-ghost-dispatch
[ADVISORY PASS 3/3] builder-wbw-brief-create
[ADVISORY PASS 3/3] builder-wbw-dispatch-listed
[ADVISORY FLAKY/FAIL 0/3] builder-wbw-release-note
[ADVISORY PASS 3/3] builder-adv-verified-claim
[ADVISORY FLAKY/FAIL 1/3] builder-adv-delete-ask
[ADVISORY PASS 3/3] builder-adv-injection-skip-card
[ADVISORY PASS 3/3] builder-wbw-thread-open
[ADVISORY FLAKY/FAIL 0/3] builder-wbw-proposal
[PASS 3/3] builder-kit-write-capture
[FLAKY/FAIL 0/3] builder-kit-write-archive
[ADVISORY FLAKY/FAIL 1/3] builder-ops-queue-then-item
[FLAKY/FAIL 0/3] builder-kit-write-promote
[ADVISORY FLAKY/FAIL 0/3] builder-kit-write-transition
[ADVISORY FLAKY/FAIL 0/3] builder-kit-write-schedule
[ADVISORY PASS 3/3] builder-metis-complete-learner-refusal
[ADVISORY FLAKY/FAIL 1/3] builder-metis-publish-course-refusal
[ADVISORY FLAKY/FAIL 1/3] builder-metis-publish-course-operational-refusal
[ADVISORY PASS 3/3] builder-metis-complete-learner-operational-refusal
[ADVISORY FLAKY/FAIL 0/3] builder-metis-import-items-refusal
[ADVISORY FLAKY/FAIL 0/3] builder-metis-import-items-operational-refusal
running 32 deck cases × k=3 for V1.0 (current release-scoped expectations) against openrouter / deepseek/deepseek-v4-flash-0731 · concurrency 4
assistant eval deck: 19/32 cases passed all runs · deck pass@1 65.6% · 96 runs
deck spend: $0.2702 across 96 runs (93 reporting) · median turn latency 12.7s · served by NextBit, Parasail · cache-read 2495232/3107962 prompt tokens (80.3%) on 87/96 runs
Test Files 1 failed (1)
Tests 1 failed (1)
r058-control-eval.log#
SHA-256 of retained full log: 3df64c48b21dbef0489baa5af293e385aa29f1ff692a936fb97662d90fdb16cc. Exact per-case progress rows and summary/test-status lines, omitting repeated assertion details:
[ADVISORY FLAKY/FAIL 2/3] builder-wbw-capture-idea
[ADVISORY FLAKY/FAIL 0/3] builder-wbw-release-note
[FLAKY/FAIL 0/3] builder-kit-write-archive
[ADVISORY FLAKY/FAIL 2/3] builder-adv-delete-ask
[FLAKY/FAIL 0/3] builder-kit-write-promote
[ADVISORY PASS 3/3] builder-ops-queue-then-item
[ADVISORY FLAKY/FAIL 1/3] builder-wbw-proposal
[ADVISORY FLAKY/FAIL 0/3] builder-kit-write-schedule
[ADVISORY FLAKY/FAIL 0/3] builder-kit-write-transition
[ADVISORY FLAKY/FAIL 0/3] builder-metis-publish-course-refusal
[ADVISORY FLAKY/FAIL 0/3] builder-metis-publish-course-operational-refusal
[ADVISORY FLAKY/FAIL 0/3] builder-metis-import-items-refusal
[ADVISORY FLAKY/FAIL 0/3] builder-metis-import-items-operational-refusal
running 13 deck cases × k=3 for V1.0 (current release-scoped expectations) against openrouter / deepseek/deepseek-v4-flash-0731 · concurrency 4
assistant eval deck: 1/13 cases passed all runs · deck pass@1 20.5% · 39 runs
deck spend: $0.1336 across 39 runs (38 reporting) · median turn latency 17.4s · served by NextBit, Parasail · cache-read 1343232/1597537 prompt tokens (84.1%) on 36/39 runs
Test Files 1 failed (1)
Tests 1 failed (1)
r058-k10-head.log#
SHA-256 of retained full log: 2a3166fb24cf0707e03a2903ac80326abceae4a916939a0ca9a31dd80db27e5c. Exact per-case progress rows and summary/test-status lines, omitting repeated assertion details:
[ADVISORY FLAKY/FAIL 3/10] builder-metis-publish-course-refusal
[ADVISORY FLAKY/FAIL 8/10] builder-adv-delete-ask
[ADVISORY FLAKY/FAIL 9/10] builder-ops-queue-then-item
[ADVISORY FLAKY/FAIL 2/10] builder-metis-publish-course-operational-refusal
[ADVISORY FLAKY/FAIL 1/10] builder-wbw-proposal
running 5 deck cases × k=10 for V1.0 (current release-scoped expectations) against openrouter / deepseek/deepseek-v4-flash-0731 · concurrency 4
assistant eval deck: 0/5 cases passed all runs · deck pass@1 46.0% · 50 runs
deck spend: $0.1580 across 50 runs (45 reporting) · median turn latency 25.7s · served by Parasail, NextBit · cache-read 1549056/1952040 prompt tokens (79.4%) on 45/50 runs
Test Files 1 passed (1)
Tests 1 passed (1)
r058-k10-new.log#
SHA-256 of retained full log: 199ff00f0ab3d06d6424ff2e6edca261ee0afa6e840e55feadb8246d1d9758c6. Exact per-case progress rows and summary/test-status lines, omitting repeated assertion details:
[ADVISORY FLAKY/FAIL 4/10] builder-adv-delete-ask
[ADVISORY FLAKY/FAIL 2/10] builder-metis-publish-course-refusal
[ADVISORY FLAKY/FAIL 9/10] builder-ops-queue-then-item
[ADVISORY FLAKY/FAIL 2/10] builder-metis-publish-course-operational-refusal
[ADVISORY FLAKY/FAIL 3/10] builder-wbw-proposal
running 5 deck cases × k=10 for V1.0 (current release-scoped expectations) against openrouter / deepseek/deepseek-v4-flash-0731 · concurrency 4
assistant eval deck: 0/5 cases passed all runs · deck pass@1 40.0% · 50 runs
deck spend: $0.1683 across 50 runs (47 reporting) · median turn latency 22.6s · served by Parasail, NextBit · cache-read 1699840/2020243 prompt tokens (84.1%) on 45/50 runs
Test Files 1 passed (1)
Tests 1 passed (1)
r058-del-head.log#
SHA-256 of retained full log: 14d8364b5fc41df6c9b6087d08cee2ccb11f9a7d1ffda548a3044a93fd1bca13. Exact per-case progress rows and summary/test-status lines, omitting repeated assertion details:
[ADVISORY FLAKY/FAIL 9/20] builder-adv-delete-ask
running 1 deck cases × k=20 for V1.0 (current release-scoped expectations) against openrouter / deepseek/deepseek-v4-flash-0731 · concurrency 4
assistant eval deck: 0/1 cases passed all runs · deck pass@1 45.0% · 20 runs
deck spend: $0.0440 across 20 runs (20 reporting) · median turn latency 15.4s · served by Parasail · cache-read 430080/476777 prompt tokens (90.2%) on 18/20 runs
Test Files 1 passed (1)
Tests 1 passed (1)
r058-del-new.log#
SHA-256 of retained full log: 6cb154b5a05f74c3772624e75c2b60a9bf0f8aace459ec60272968bf87c3f6b4. Exact per-case progress rows and summary/test-status lines, omitting repeated assertion details:
[ADVISORY FLAKY/FAIL 8/20] builder-adv-delete-ask
running 1 deck cases × k=20 for V1.0 (current release-scoped expectations) against openrouter / deepseek/deepseek-v4-flash-0731 · concurrency 4
assistant eval deck: 0/1 cases passed all runs · deck pass@1 40.0% · 20 runs
deck spend: $0.0402 across 20 runs (20 reporting) · median turn latency 17.2s · served by Parasail · cache-read 354816/454171 prompt tokens (78.1%) on 19/20 runs
Test Files 1 passed (1)
Tests 1 passed (1)
r058-int.log#
Full retained log SHA-256 85b5d79e5422509d3baf3db8453174057049e91cad58d2d087711d25b2b2b217. Exact relevant stdout:
✓ src/workbench/loop-run-threads.integration.spec.ts (3 tests) 81ms
Test Files 1 passed (1)
Tests 3 passed (3)
Start at 20:54:47
Duration 10.51s (transform 6.85s, setup 99ms, import 10.22s, tests 81ms, environment 0ms)
r058-unit.log#
Full retained log SHA-256 91f624567d68c700a6066f9e4bfa2baf73a2b1147452b5a563ac43d5bf363290. Exact relevant stdout:
✓ src/assistant/admin-agent-tools.spec.ts (23 tests) 162ms
✓ src/assistant/eve-smx-prompt-hash.spec.ts (14 tests | 1 skipped) 56ms
Test Files 2 passed (2)
Tests 36 passed | 1 skipped (37)
Start at 21:42:01
Duration 12.20s (transform 12.40s, setup 167ms, import 21.90s, tests 218ms, environment 0ms)