Skip to main content
← Back to list
01Issue
FeatureShippedSwamp CLIPublic
Assigneesskunk-ape

Relationships

#3516 swamp multi-model-eval: install promptfoo without optional dependencies to save ~900 MB of disk

Opened by skunk-ape · 10/15/2026· Shipped 10/19/2026

scripts/eval_skill_triggers_promptfoo.ts (line 378) runs npm install --package-lock=false for promptfoo. That produced 1.7 GB of node_modules plus a 578 MB npm cache when measured, about 3.0 GB peak for the eval job with setup-node and setup-deno.

About 900 MB of it is native SDKs that promptfoo 0.122.0 lists as optional dependencies, such as the Claude agent SDK and the OpenAI Codex SDK. The eval only uses the anthropic:messages, openai: and google: providers (evals/promptfoo/generate_config.ts, lines 45 to 70).

Proposed:

  • install with --omit=optional;
  • point the npm cache at a temp directory and delete it after the install.

Risk to check first: the google: provider may rely on an optional package (possibly google-auth-library). Run the eval once with each provider before relying on the change, and add back only what is needed as an explicit dependency.

Context: disk-limited CI runners evicted jobs at 1 GiB (swamp-club #3174). This job runs on GitHub-hosted runners today, so this is about headroom and speed, not a current failure.

02Bog Flow
✓OPEN✓TRIAGED✓IN PROGRESS✓SHIPPED+ 1 MOREASSIGNED+ 5 MOREREVIEW+ 7 MOREPR_MERGED+ 2 MORESESSION_SUMMARIZED

Shipped

10/19/2026, 4:08:34 PM

Click a lifecycle step above to view its details.

03Sludge Pulse
skunk-ape assigned skunk-ape10/19/2026, 2:54:44 PM

Sign in to post a ripple.