Skip to content

CI: test on Node.js 26, the runtime operator machines run (RA-020) - #88

Merged
JOsacky merged 1 commit into
mainfrom
ci/node-26-matrix-ra020
Nov 15, 2026
Merged

JOsacky merged 1 commit into
mainfrom
ci/node-26-matrix-ra020

Conversation

@JOsacky

@JOsacky JOsacky commented Nov 15, 2026

Copy link
Copy Markdown
Member

Why

  • The operator Mac's skillhook daemons have run on Node 26.13.0 since Homebrew upgraded on 2026-11-03.
  • CI tests only Node 22 and 24, so the runtime production uses is never exercised.

What we found (reliability-audit, RA-020)

  • The 11-13 kill: macOS jetsam (OS_REASON_JETSAM) killed the main daemon after a 30-min stall.
    • The jetsam report lists the daemon as the largest process: 23.1M resident pages against 0.18M for the next one.
    • Its CPU report puts 24 of 26 samples in Http2Session::SendPendingData / nghttp2_session_mem_send.
  • Repeat on 11-10: the same signature, but the daemon survived. 405 other processes were killed.
  • Why HTTP/2: a local probe shows Node 26's built-in fetch (undici 8.12.2) negotiates HTTP/2, while Node 22 (undici 6.29.1) uses HTTP/1.1. The CLI does not import http2 itself.

Change

  • ci.yml matrix: [22, 24] → [22, 24, 26].
  • Only CI changes. Runtime behaviour is untouched.

Follow-ups, tracked in RA-020

  • Make the daemon's outbound fetch use HTTP/1.1 via undici's Agent({ allowH2: false }) and setGlobalDispatcher, with a local h2 test.
    • Node's bundled dispatcher is created lazily on the first fetch, so it cannot be swapped without the package.
  • A worker-thread watchdog for stalls and RSS.

🤖 Generated with Claude Code

Homebrew moved the operator Mac to Node 26.13.0 on 2026-11-03. Its
built-in fetch (undici 8.12.2) negotiates HTTP/2, while Node 22 uses
HTTP/1.1. Since then the daemon has twice run away inside Node's native
HTTP/2 write path (2026-11-10, 2026-11-13) until macOS jetsam killed it.
CI only tested 22 and 24, so the runtime production actually uses was
never exercised.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@JOsacky
JOsacky merged commit 453b25d into main Nov 15, 2026
7 checks passed
@JOsacky
JOsacky deleted the ci/node-26-matrix-ra020 branch November 15, 2026 12:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant