Date: 2026-07-27
Repository base commit under test: 2943aac34803f6d3d0293310ea92c14afacd1779.
The source and test corrections described here are committed with this evidence.
Outcome#
The Metis learner and admin correction surfaces now have executed Firefox and WebKit coverage. Firefox completed the entire 36-test learner project with no retry. WebKit completed every executable learner case with no failure: 35 passed and one authenticated service-worker cache case was explicitly skipped for the bounded runner defect below. The canonical admin governance correction flow passed independently in both engines.
This evidence does not close either open V9-004 checklist item. Native Maestro is still unexecuted, broad mobile/offline/localization/embodiment/bridge/payout launch proof is incomplete, and one WebKit service-worker assertion remains blocked.
Environment#
- Playwright: 1.60.0
- Firefox: 150.0.2, Playwright revision 1522
- WebKit: 26.4, Playwright revision 2287
- Worker count: 1
- Retries: 0
- Host memory during runs: 15 GiB RAM and 31 GiB swap; observed available memory stayed at or above 10 GiB
Executed verification#
| Scope | Command | Result |
|---|---|---|
| Learner unit suite | pnpm run test |
PASS — 91/91 across 26 files |
| Learner typecheck | pnpm run typecheck |
PASS |
| Learner lint | pnpm run lint |
PASS |
| Firefox learner project | pnpm exec playwright test --project=firefox --workers=1 --retries=0 |
PASS — 36/36 in 5.0m |
| WebKit learner project | pnpm exec playwright test --project=webkit --workers=1 --retries=0 |
PASS — 35 passed, 1 explicit skip, 0 failures in 4.6m |
| Firefox admin correction | pnpm exec playwright test e2e/review-queues.spec.ts --project=firefox --workers=1 --retries=0 |
PASS — 1/1 |
| WebKit admin correction | pnpm exec playwright test e2e/review-queues.spec.ts --project=webkit --workers=1 --retries=0 |
PASS — 1/1 |
The learner projects include four automated accessibility scenarios covering course detail, assessment detail, tutoring, and authoring. All four passed in both Firefox and WebKit as part of the complete runs. Earlier isolated accessibility runs also passed 4/4 in each engine.
Defects closed#
- The PWA browser assertion expected five successful warm requests while the
canonical runtime defined seven. The service worker also omitted
/studyand/savedfrom its warm and navigation caching policies. The policy now matches the canonical route set, and the unit test prevents drift. - PWA warmup could begin while authentication was unresolved and then suppress the authenticated retry because the route signature was unchanged. Warmup now waits until auth resolution.
- WebKit exposed client-navigation races where direct
page.gotocalls competed with app navigation. Assessment and learner-surface tests now use their actual user links. - WebKit exposed login-form hydration clearing an already-filled email field. The test now waits for the anonymous session response and asserts both field values before submission.
- The checklist cited a nonexistent rendered-surface commit. The corrected
source commit is
3cfa8c72df0330142c54d5bccf0633733a87e1e6.
Honest WebKit boundary#
With service workers enabled in Playwright WebKit, a request controlled by the
worker loses the test's HttpOnly metis-session cookie. The protected shell
routes therefore redirect to /login, while / remains cacheable. The same
cookie and routes work in Firefox, and non-service-worker WebKit learner and
admin flows pass.
The E2E test records this as an engine-specific skip:
Playwright WebKit drops the HttpOnly session from service-worker-controlled requests
The application does not bypass middleware, expose the HttpOnly credential, or
cache login redirects to manufacture a pass. This WebKit PWA case and the native
mobile blocker in evidence/v1-v9/V9-004-MOBILE-E2E-EXECUTION-ATTEMPT.md remain
open.
A Next production build was not run: the host has 15 GiB RAM, and the workspace memory-safety policy requires explicit approval before a Next production build on a sub-32-GiB host. Typecheck, lint, unit, and the two complete browser projects provide the executable verification for this slice.