Observed 2026-09-14T16:39:42.097Z; implementation
c6396240983aafd04e40168aa130e44014016031; immutable record snapshot
ca2ff9b34727785d9d7483806e9fd8b0df3e58c1; focused review repair
e3e774b15c6f4dac07d2157a3de699e2e544ff6a; supplemental receipt snapshot
3b5f71d7e1012539851444b7a1ade7d8f61afeb2. The preregistered contract digest is
ae44527017c95e916918e8c1d383d91562f08f918eb9455acd5c04a04e2088a6 and the
retained record digest is
044a455244fe2d08de0b7d5cc005f9aae4080dfbc6ff22d4c7ed395f80f6331c.
Result#
PASS. Five expensive surfaces ran serially for 300.265 seconds total with 900 observations. Maximum simultaneous expensive surfaces was 1; the host-safety abort flag remained false. Every observation succeeded, no observation timed out, and no duplicate effect occurred.
| Surface | Observations | Configured concurrency | p50 ms | p95 ms | p99 ms | Error rate | Timeout rate | Duplicate-attempt rate | Duplicate-effect rate |
|---|---|---|---|---|---|---|---|---|---|
| stream-tool | 100 | 4 | 1534.783 | 2711.646 | 3201.943 | 0.0% | 0.0% | 0.0% | 0.0% |
| queue | 100 | 4 | 57.558 | 149.675 | 151.558 | 0.0% | 0.0% | 100.0% | 0.0% |
| vector-search | 500 | 8 | 5.651 | 10.343 | 17.996 | 0.0% | 0.0% | 0.0% | 0.0% |
| watcher | 100 | 4 | 11.776 | 19.338 | 37.008 | 0.0% | 0.0% | 100.0% | 0.0% |
| long-job | 100 | 4 | 84.928 | 103.588 | 165.724 | 0.0% | 0.0% | 0.0% | 0.0% |
Queue and watcher deliberately replay every operation once, so their 100% duplicate-attempt rates prove idempotency pressure; the outcome guard is the 0% duplicate-effect rate.
Stream, tool, and provider result#
The production OpenRouter resolver served deepseek/deepseek-v4-flash-0731
through fp8 routing. All 100 turns executed the required read-only tool exactly
once and completed. Total-turn latency was p50 1534.783 ms, p95 2711.646 ms, and
p99 3201.943 ms. Time to first meaningful tool/text event was p50 764.959 ms,
p95 1222.470 ms, and p99 1420.187 ms.
Tool-bearing first iterations were narrowed to baidu/fp8. The final permitted
iteration deliberately disables tools; 94 turns remained on Baidu and six
accumulated Baidu plus StreamLake response provenance across their two
iterations. This is consistent with the request-scoped pin and does not claim
StreamLake served a tool-bearing request.
The canonical prompt-template descriptor SHA-256 is
3038d890424ad07a093b383e436ff4545f00c32a2a31afdc0331b9661b6ec0e3. It
represents the source-fixed system prompt, token placeholder, tool schema/result
shape, iteration policy, and output ceiling. Per-observation aggregate
input/output tokens and OpenRouter-reported billed cost are retained.
Actual billed provider cost was $0.023782300 total. Per outcome: p50 $0.000237224, p95 $0.000252624, p99 $0.000253944, maximum $0.000254824. All 100 outcomes reported cost across 63052 aggregate input and 5252 aggregate output tokens, an observed blended $0.348183/M reported tokens.
Cost reconciliation: the registry's 2026-09-05 endpoint-feed values ($0.04998/M
input and $0.09996/M output) were an admission-time planning snapshot, not the
billing formula for this 2026-09-14 run. Applying them to the retained aggregate
tokens predicts $0.003676329, while OpenRouter's retained usage.cost totals
$0.023782300 (6.469×). The receipt aggregates two iterations per turn but does
not retain per-iteration provider price, cache-token class, or provider billing
adjustments, so a defensible input/output-rate decomposition cannot be
reconstructed. The evidence therefore treats the provider-reported billed-call
total—not the older registry planning snapshot—as authoritative, and records the
missing billing dimensions explicitly instead of presenting the two as
equivalent.
Persistence and runtime provenance#
- Queue: PostgreSQL 16.14 (Debian 16.14-1.pgdg12+1),
WorkbenchIntentStorethroughWorkbenchQueue, four tenant queues, restart readback passed. - Vector search: Qdrant 1.19.1 (6ab21cac18ebb6f4ae29102c7f8f5cc11affd5de), 1,000
indexed 16-dimensional records through
QdrantVectorBackend, restart readback passed. The focused real-Qdrant 1.19.1 supplement then proved two distinct namespaces, fresh v1→v2 update visibility with stale absence, zero cross-namespace records, a new-adapter readback, point deletion with peer preservation, and both collection deletions returning 404 and rejecting adapter queries. - Watcher: PostgreSQL 16.14 (Debian 16.14-1.pgdg12+1),
PostgresWatcherStorepluswatcher-engine, 100 deliveries across four watchers, restart readback passed. - Long job:
ContentPipelineServicewithFileContentRunStoreandFileCheckpointStore; 100/100 runs persisted and recovered after restart readback. The focused recovery supplement sustained 1118/1108 ms of work before/after a durable incomplete checkpoint, resumed it through a freshPipelineRunnerandFileCheckpointStore, preserved one run ID across two dispatches, and did not replay the already-completed step.
Resource envelope#
Process CPU is percentage of one logical core and may exceed 100% for parallel local work. The host has 4 logical CPUs.
| Surface | Baseline RSS MiB | Peak RSS MiB | RSS growth MiB | Peak process CPU | Peak host CPU | Minimum available memory GiB | Minimum critical-disk free GiB |
|---|---|---|---|---|---|---|---|
| stream-tool | 468.5 | 488.2 | 19.6 | 48.2% | 80.0% | 12.97 | 1.68 |
| queue | 496.1 | 503.1 | 6.9 | 288.2% | 100.0% | 12.95 | 1.68 |
| vector-search | 504.1 | 515.7 | 11.6 | 54.3% | 100.0% | 12.93 | 1.68 |
| watcher | 441.0 | 441.0 | 0.0 | 296.1% | 100.0% | 12.99 | 1.68 |
| long-job | 444.7 | 444.7 | 0.0 | 292.2% | 100.0% | 13.01 | 1.68 |
The contract required at least 2.00 GiB available memory, at least 1.00 GiB on every critical disk target, and no more than 256.0 MiB process-RSS growth. Every surface remained inside all three guards.
Observed failure, diagnosis, and recovery#
Attempt 03 stopped honestly after the stream/tool surface: 93/100 observations
failed, all as forced-tool-not-executed. The bounded endpoint diagnostic then
measured:
baidu/fp8: 4/4 exact tool executions, 0.0% errors.deepinfra/fp8: 0/4 exact tool executions, 100.0% errors.streamlake/fp8: 0/4 exact tool executions, 100.0% errors.
The production repair introduced a request-scoped toolOnly: ['baidu/fp8']
route while preserving the broader non-tool route and explicit environment
override precedence. Attempt 04 then passed the same locked stream/tool workload
100/100 before the other four surfaces ran. The failed record, diagnostic,
repair source, and passing record are all retained; thresholds were not
weakened.
Verification cadence#
Recovered stage: CANDIDATE-REVIEW → FOCUSED-REPAIR after independent
reviewers identified four semantic gaps. Reused green receipts were shared-AI
lint, BFF lint, 41 shared-AI tests, 43 BFF registry/config tests, shared-AI
typecheck, BFF typecheck, and all five Attempt 04 load surfaces. Review
invalidated only Qdrant lifecycle completeness, incomplete-job resume realism,
price reconciliation, and exact-one-tool verifier enforcement. Repairs added
direct fail-closed controls plus one focused Qdrant lifecycle run and one
focused durable-resume run. Attempt 04 and its provider, queue, vector-load,
watcher, and original long-job surfaces were not rerun.
Limits#
- This is a supervised local candidate with synthetic minimized inputs, not production traffic or a rolling 30-day SLO window.
- Each surface receives sixty seconds of observation. This can reveal immediate saturation, leaks, duplicate effects, and deadline failures, but it is not a multi-hour or multi-day endurance claim.
- The stream/tool surface uses the real production OpenRouter binding and records billed cost; queue, vector, watcher, and long-job surfaces are local dependencies with zero variable provider spend.
- The Qdrant surface proves the shipped Qdrant adapter. The local pgvector cosine operator is not claimed because the host extension currently fails with recursive cosine_distance stack exhaustion.
- The long-job surface exercises the production durable content pipeline with real filesystem run/checkpoint stores and deterministic local model doubles; it does not claim an external generation provider or deployed object store.
- Destructive dependency outages, network partitions, process crashes during effects, restore RPO/RTO, deployed dashboards/alerts, and a game day remain Tasks 13.5 through 13.7.