Eve library

V9-004 cross-browser E2E evidence

Evidence

Revision 1

On this page

Date: 2026-07-27

Repository base commit under test: 2943aac34803f6d3d0293310ea92c14afacd1779. The source and test corrections described here are committed with this evidence.

Outcome#

The Metis learner and admin correction surfaces now have executed Firefox and WebKit coverage. Firefox completed the entire 36-test learner project with no retry. WebKit completed every executable learner case with no failure: 35 passed and one authenticated service-worker cache case was explicitly skipped for the bounded runner defect below. The canonical admin governance correction flow passed independently in both engines.

This evidence does not close either open V9-004 checklist item. Native Maestro is still unexecuted, broad mobile/offline/localization/embodiment/bridge/payout launch proof is incomplete, and one WebKit service-worker assertion remains blocked.

Environment#

  • Playwright: 1.60.0
  • Firefox: 150.0.2, Playwright revision 1522
  • WebKit: 26.4, Playwright revision 2287
  • Worker count: 1
  • Retries: 0
  • Host memory during runs: 15 GiB RAM and 31 GiB swap; observed available memory stayed at or above 10 GiB

Executed verification#

Scope Command Result
Learner unit suite pnpm run test PASS — 91/91 across 26 files
Learner typecheck pnpm run typecheck PASS
Learner lint pnpm run lint PASS
Firefox learner project pnpm exec playwright test --project=firefox --workers=1 --retries=0 PASS — 36/36 in 5.0m
WebKit learner project pnpm exec playwright test --project=webkit --workers=1 --retries=0 PASS — 35 passed, 1 explicit skip, 0 failures in 4.6m
Firefox admin correction pnpm exec playwright test e2e/review-queues.spec.ts --project=firefox --workers=1 --retries=0 PASS — 1/1
WebKit admin correction pnpm exec playwright test e2e/review-queues.spec.ts --project=webkit --workers=1 --retries=0 PASS — 1/1

The learner projects include four automated accessibility scenarios covering course detail, assessment detail, tutoring, and authoring. All four passed in both Firefox and WebKit as part of the complete runs. Earlier isolated accessibility runs also passed 4/4 in each engine.

Defects closed#

  1. The PWA browser assertion expected five successful warm requests while the canonical runtime defined seven. The service worker also omitted /study and /saved from its warm and navigation caching policies. The policy now matches the canonical route set, and the unit test prevents drift.
  2. PWA warmup could begin while authentication was unresolved and then suppress the authenticated retry because the route signature was unchanged. Warmup now waits until auth resolution.
  3. WebKit exposed client-navigation races where direct page.goto calls competed with app navigation. Assessment and learner-surface tests now use their actual user links.
  4. WebKit exposed login-form hydration clearing an already-filled email field. The test now waits for the anonymous session response and asserts both field values before submission.
  5. The checklist cited a nonexistent rendered-surface commit. The corrected source commit is 3cfa8c72df0330142c54d5bccf0633733a87e1e6.

Honest WebKit boundary#

With service workers enabled in Playwright WebKit, a request controlled by the worker loses the test's HttpOnly metis-session cookie. The protected shell routes therefore redirect to /login, while / remains cacheable. The same cookie and routes work in Firefox, and non-service-worker WebKit learner and admin flows pass.

The E2E test records this as an engine-specific skip:

Playwright WebKit drops the HttpOnly session from service-worker-controlled requests

The application does not bypass middleware, expose the HttpOnly credential, or cache login redirects to manufacture a pass. This WebKit PWA case and the native mobile blocker in evidence/v1-v9/V9-004-MOBILE-E2E-EXECUTION-ATTEMPT.md remain open.

A Next production build was not run: the host has 15 GiB RAM, and the workspace memory-safety policy requires explicit approval before a Next production build on a sub-32-GiB host. Typecheck, lint, unit, and the two complete browser projects provide the executable verification for this slice.