#146

feat: add support for Nix via a flake

s12d ago

← Back to list

01Issue

BugClosedSwamp Club

AssigneesNone

Relationships

#1023 Beta-channel extensions are never scored — perpetual 'Scoring is taking longer than expected'

Opened by magistr · 7/7/2026

Correction (rewritten): the first version of this report claimed a platform-wide scoring outage since ~2026-07-04 across all channels. That was wrong — it was an artifact of my method (swamp extension search --json omits the score field entirely, so every row read as "unscored" when the field was simply never projected; see #1024). Per-extension swamp extension info shows stable extensions are scored. The real, narrower issue is below: beta-channel extensions are not scored.

Summary

Extensions released to the beta channel never receive a quality score. Their detail pages on swamp.club show, indefinitely:

ERR: Scoring is taking longer than expected. Refresh the page in a moment to check the result.

Refreshing never resolves it. On the beta-channel view essentially every extension is unscored (one exception observed). Stable-channel extensions score normally.

Environment

CLI version: 20260707.202458.0-sha.17103ab8
Account: magistr
Observed: 2026-07-07 / 2026-07-08

Reproduction

Publish an extension to beta only: swamp extension push <manifest> --channel beta.
Open its detail page on swamp.club → "Scoring is taking longer than expected…" that never resolves.
From the CLI: swamp extension info <name> --json → latestVersion: null, latestBeta: <ver>, "score": null.

Evidence

Beta-only extension — unscored:

$ swamp extension info @magistr/stripe-mpp --json
  "latestVersion": null,
  "latestBeta": "2026.07.03.1",
  "score": null

Stable extensions checked individually via swamp extension info — all scored (each has latestVersion set, latestBeta: null, and a populated score): @swamp/gcp/compute, @figura/cribl-stream, @jamesakeech/spotify, @keeb/peloton-rides, @dougschaefer/azure, @atalanta/meta-factory — plus older ones like @goodcraft/stripe, @magistr/career-kb, @magistr/pihole.

The web UI's beta-channel view additionally shows ~every beta extension unscored with the same timeout message (only one scored exception observed) — consistent with the scorer not running (or not persisting a score) for beta/pre-release versions.

Impact

Extensions in beta/pre-release get no score, so publishers testing via the beta channel can't see rubric results before promoting to stable.
The beta-channel browse view is effectively all-unscored, and the "refresh in a moment" hint is misleading — it reads as transient when the score never arrives.

Likely area

The extension rubric scorer appears to only run/persist for stable (and rc?) releases, not beta — or the beta scoring path stalls and the job never completes (matching the perpetual "taking longer than expected" state). Worth checking whether the scorer is enqueued at all on a --channel beta push.

#1024 — swamp extension search --channel filter is ignored (all channels return the same set), which is why beta extensions can't be enumerated from the CLI to audit this. (Not the cause of the scoring gap, but it blocked the investigation.)

02Bog Flow

Closed

7/7/2026, 11:21:44 PM

No activity in this phase yet.

03Sludge Pulse

stack72 commented 7/7/2026, 11:21:43 PM

Closing as a dupe of #1025

Scorecard: beta/rc-only extensions show "not scored" despite successful scoring (GET /score resolves only latestVersion)

`swamp extension search --channel beta|rc|stable` ignores the filter — all channels + the no-flag default return an identical result set

Beta-channel extensions are never scored — perpetual 'Scoring is taking longer than expected'

feat: allow models to call other models mid-execution via context.runModel()

swamp-club: enable OAuth provider for swamp serve collective-based admission

extension update/install reports new version while on-disk pulled files stay old

command/shell: step with timeout + a surviving child process reports exit -1 despite command exiting 0

swamp serve startup/shutdown is very slow on large repo and lacks diagnostics

Vault push log overstates what left the machine: Pushed N vault file(s) to datastore counts every dirty file, not just vault files

serve-auth: mode: oauth — device grant client + collective-based admission

serve-auth: enable OIDC Provider + Device Authorization plugins in swamp-club

Orphaned data (migrated-away/deleted model) can't be GC'd or deleted

Docs: document swamp data prune (orphaned-data reclamation)

UAT: CLI coverage for swamp data prune (orphaned-data reclamation)

Session credential revocation scans entire credential map on every dispatch completion

Docs: update worker-commands.md for --all flag and JSON output change

datastore migrate-index aborts on hardcoded 30s S3 requestTimeout for large shards

swamp worker list: hide disconnected workers by default, add --all flag

swamp serve should survive bad extension failures

Worker fleets phase 7: how-to guides and explanation docs

swamp serve: catch unhandled promise rejections from extensions

[@adam/cfgmgmt] SSH helper can crash swamp serve via unhandled finally() rejection

Docs: add --server-token flag to worker connect reference

Add --server-token to worker connect for authenticated orchestrators

Docs: document --trusted-hosts flag for swamp serve

Document SWAMP_SERVE_EXTRA_HEADERS for reverse proxy/tunnel setups

Add --trusted-hosts flag to swamp serve for Docker/Kubernetes worker connections

Allow swamp clients to send custom headers when connecting to swamp serve

Docs: update serve-flags.md default queue timeout from 60s to 10m

Worker fleets phase 6: raise default queue timeout to 10 minutes

Worker fleets phase 4b: capacity slots and concurrent dispatch

MethodContext docs/comments mention context.putSecret but runtime exposes vaultService.put

Docs: add --concurrency flag and SLOTS column to worker-commands reference

install.sh still points users to systeminit/swamp

Support user systemd units for 'swamp serve daemon enable'

swamp serve scheduled execution runs steps in an isolated data scope: readResource sees empty state, writeResource never reaches the model-scope chain — stateful scheduled workflows duplicate instead of deduplicating

Support installing swamp via mise GitHub backend

Worker fleets phase 4a: dispatch runner extraction — child process per dispatch

Docs: add swamp worker daemon enable/disable/status to worker-commands reference

Worker fleets phase 3 PR2: swamp worker daemon enable

Docs: add drain, lifecycle policies, and exit-code contract to references

Worker fleets phase 3 PR1: drain state machine, lifecycle policies, signal handling

Leaderboard search excludes ghosts — a visible ghost can't be found by its alias

issue-lifecycle: plan lifecycle entry silently dropped when summary exceeds 1000 chars

Docs: add worker verify, --verify-on-enroll, and env-var config to references

Labs - Filters do not apply to Blocked status and Billing Tier category

Worker fleets phase 2 PR2: env-var config, swamp worker verify, --verify-on-enroll

Docs: add --type flag to issue edit reference and how-to

Docs: update manual with whole-field expression syntax for workflow task inputs/globalArgs

Allow changing an existing issue to security/confidential after submission

Allow dynamic object expressions for workflow task inputs/globalArgs

Docs: update enrollment token references for fleet tokens (--max-enrollments)

Worker fleets phase 2 PR1: fleet tokens (--max-enrollments, bindings, worker naming)

$identify events are never consumed — anonymous web history never binds to the account

Worker fleets phase 1 PR3: boot reconciliation and integration test

Login success still shows login tip

Support confidential visibility for non-security issues

Fine-grained scopes for swamp.club access tokens

Add associative info to user profiles: collective membership + collaborative contributions

Remove comments from /feed and redesign the page

feed_post_score_events queue grows unboundedly (no TTL, no delete-on-delivery)

Make paid subscribers visually stand out (badge, profile popup summary)

Relax the profanity filter

Giphy integration via /giphy command

@-mention autocomplete for users when writing lab ripples

Worker fleets phase 1 PR2: step_queued events, pending-dispatch model, queue introspection

Docs: add swamp worker queue to worker-commands reference

/lab shipped list is sorted by issue number, not ship date

Docs: update manual for ephemeral data and step-output dependency deferral

Docs: update remote execution references for elastic queueing

Support dynamic host discovery from external sources

Worker fleets phase 1: elastic queueing

catalog backfill should support scoped population for targeted lookups

Docs: document global skill sync behavior for custom tools in manual

swamp update syncs global skills to default agent directories instead of configured custom Pi skillsDir

coerceToSuffix does not sanitize path-unsafe characters, causing forEach items and vary dimensions with / to produce invalid data instance names

Badge for activity on other people's issues

swamp serve: add @keychain=<service>/<account> indirection for secret args on macOS

swamp serve: eliminate wrapper scripts via @vault= secret refs and native startup hooks

Automate mechanical frontmatter fixes in the fixing stage