#146

feat: add support for Nix via a flake

s12d ago

← Back to list

01Issue

FeatureOpenSwamp CLI

AssigneesNone

Relationships

#937 swamp serve: eliminate wrapper scripts via @vault= secret refs and native startup hooks

Opened by stack72 · 7/3/2026

Context

Downstream operators run `swamp serve` under a service manager (launchd, systemd, etc.). Two things force every deployment to wrap swamp in a shell script today:

Secrets have to be materialised. Webhook signing secrets and any observability keys (Honeycomb ingest, OTEL exporter headers) live in `swamp vault`, but plist / unit files can't run `swamp vault read-secret`. `--webhook :@env=VAR` and `--webhook :@file=/path` exist, but VAR / file still need to come from somewhere — a wrapper or a materialisation step.
Startup housekeeping has to run. Our factory driver needs `reconcileOrphanedDispatches` to fire N seconds after boot so it can catch dispatches killed with the previous instance. That's a detached background job in the wrapper.

Our current wrapper is 100 lines that read two vault entries, export three OTEL env vars, background a reconcile call, and `exec` swamp. Every deployment writes the same wrapper.

Ask

Two features that together let us delete the wrapper:

1. Native vault reference for secret args

Extend the `@env=` / `@file=` indirection used by `--webhook` to also accept:

``` --webhook '/hooks/linear:linear-webhook:@vault=linear/webhook-secret:linear' ```

Semantics: `@vault=/` resolves via the same code path as `swamp vault read-secret `, at serve start (and on config reload if that lands). Same idea for arbitrary flags that carry secrets, if any grow later.

Rationale: the vault is already the platform-blessed secret store; forcing operators to also maintain `chmod 600` files that mirror the vault duplicates state and drifts on rotation. This closes the gap.

2. Startup hooks / `--on-start` action

Let a serve instance run a swamp method or workflow once, N seconds after the listener comes up. Two shapes worth considering:

`--on-start '::[:--input k=v ...]'`, repeatable.
`--on-start-workflow ':[:--input …]'`.

Rationale: today every operator that wants a "resume in-flight work after restart" behaviour has to background a `sleep 30 && swamp model method run …` in their wrapper. The retry / logging story is on them. If the runtime owns this, the wrapper collapses.

Anti-goals

Not asking for full systemd-esque post-start ordering — just one or two invocations with a delay.
Not asking for arbitrary shell in the flag; the invocation should be a swamp method or workflow, not a shell command.

Prior art

`--webhook :@env=` and `--webhook :@file=` set the precedent for indirection in flag values.
`--no-schedule` already gates a class of background behaviour, so there's precedent for serve owning its own periodic work.

Impact

Every downstream that runs `swamp serve` under a supervisor. Concretely: our factory serve wrapper drops from 100 lines to zero; the plist calls swamp directly.

Existing docs work: #1690 (document `@env=` / `@file=`), #1699 (`--ws-idle-timeout`), #1714 (phase-2 `--server`).

Automoved by swampadmin from https://github.com/swamp-club/swamp/issues/1738

02Bog Flow

Open

7/3/2026, 11:16:05 AM

No activity in this phase yet.

03Sludge Pulse

Scorecard: beta/rc-only extensions show "not scored" despite successful scoring (GET /score resolves only latestVersion)

`swamp extension search --channel beta|rc|stable` ignores the filter — all channels + the no-flag default return an identical result set

Beta-channel extensions are never scored — perpetual 'Scoring is taking longer than expected'

feat: allow models to call other models mid-execution via context.runModel()

swamp-club: enable OAuth provider for swamp serve collective-based admission

extension update/install reports new version while on-disk pulled files stay old

command/shell: step with timeout + a surviving child process reports exit -1 despite command exiting 0

swamp serve startup/shutdown is very slow on large repo and lacks diagnostics

Vault push log overstates what left the machine: Pushed N vault file(s) to datastore counts every dirty file, not just vault files

serve-auth: mode: oauth — device grant client + collective-based admission

serve-auth: enable OIDC Provider + Device Authorization plugins in swamp-club

Orphaned data (migrated-away/deleted model) can't be GC'd or deleted

Docs: document swamp data prune (orphaned-data reclamation)

UAT: CLI coverage for swamp data prune (orphaned-data reclamation)

Session credential revocation scans entire credential map on every dispatch completion

Docs: update worker-commands.md for --all flag and JSON output change

datastore migrate-index aborts on hardcoded 30s S3 requestTimeout for large shards

swamp worker list: hide disconnected workers by default, add --all flag

swamp serve should survive bad extension failures

Worker fleets phase 7: how-to guides and explanation docs

swamp serve: catch unhandled promise rejections from extensions

[@adam/cfgmgmt] SSH helper can crash swamp serve via unhandled finally() rejection

Docs: add --server-token flag to worker connect reference

Add --server-token to worker connect for authenticated orchestrators

Docs: document --trusted-hosts flag for swamp serve

Document SWAMP_SERVE_EXTRA_HEADERS for reverse proxy/tunnel setups

Add --trusted-hosts flag to swamp serve for Docker/Kubernetes worker connections

Allow swamp clients to send custom headers when connecting to swamp serve

Docs: update serve-flags.md default queue timeout from 60s to 10m

Worker fleets phase 6: raise default queue timeout to 10 minutes

Worker fleets phase 4b: capacity slots and concurrent dispatch

MethodContext docs/comments mention context.putSecret but runtime exposes vaultService.put

Docs: add --concurrency flag and SLOTS column to worker-commands reference

install.sh still points users to systeminit/swamp

Support user systemd units for 'swamp serve daemon enable'

swamp serve scheduled execution runs steps in an isolated data scope: readResource sees empty state, writeResource never reaches the model-scope chain — stateful scheduled workflows duplicate instead of deduplicating

Support installing swamp via mise GitHub backend

Worker fleets phase 4a: dispatch runner extraction — child process per dispatch

Docs: add swamp worker daemon enable/disable/status to worker-commands reference

Worker fleets phase 3 PR2: swamp worker daemon enable

Docs: add drain, lifecycle policies, and exit-code contract to references

Worker fleets phase 3 PR1: drain state machine, lifecycle policies, signal handling

Leaderboard search excludes ghosts — a visible ghost can't be found by its alias

issue-lifecycle: plan lifecycle entry silently dropped when summary exceeds 1000 chars

Docs: add worker verify, --verify-on-enroll, and env-var config to references

Labs - Filters do not apply to Blocked status and Billing Tier category

Worker fleets phase 2 PR2: env-var config, swamp worker verify, --verify-on-enroll

Docs: add --type flag to issue edit reference and how-to

Docs: update manual with whole-field expression syntax for workflow task inputs/globalArgs

Allow changing an existing issue to security/confidential after submission

Allow dynamic object expressions for workflow task inputs/globalArgs

Docs: update enrollment token references for fleet tokens (--max-enrollments)

Worker fleets phase 2 PR1: fleet tokens (--max-enrollments, bindings, worker naming)

$identify events are never consumed — anonymous web history never binds to the account

Worker fleets phase 1 PR3: boot reconciliation and integration test

Login success still shows login tip

Support confidential visibility for non-security issues

Fine-grained scopes for swamp.club access tokens

Add associative info to user profiles: collective membership + collaborative contributions

Remove comments from /feed and redesign the page

feed_post_score_events queue grows unboundedly (no TTL, no delete-on-delivery)

Make paid subscribers visually stand out (badge, profile popup summary)

Relax the profanity filter

Giphy integration via /giphy command

@-mention autocomplete for users when writing lab ripples

Worker fleets phase 1 PR2: step_queued events, pending-dispatch model, queue introspection

Docs: add swamp worker queue to worker-commands reference

/lab shipped list is sorted by issue number, not ship date

Docs: update manual for ephemeral data and step-output dependency deferral

Docs: update remote execution references for elastic queueing

Support dynamic host discovery from external sources

Worker fleets phase 1: elastic queueing

catalog backfill should support scoped population for targeted lookups

Docs: document global skill sync behavior for custom tools in manual

swamp update syncs global skills to default agent directories instead of configured custom Pi skillsDir

coerceToSuffix does not sanitize path-unsafe characters, causing forEach items and vary dimensions with / to produce invalid data instance names

Badge for activity on other people's issues

swamp serve: add @keychain=<service>/<account> indirection for secret args on macOS

swamp serve: eliminate wrapper scripts via @vault= secret refs and native startup hooks

Automate mechanical frontmatter fixes in the fixing stage