Package everything on ops.swamp-club.com; stop direct server edits

23h ago

#4238

artifacts.swamp-club.com unreachable in Spain during LaLiga matches (ISP blocking of Cloudflare IPs)

3d ago

#4038

Shared dispatch bookkeeping queue delays completed worker results by up to 58 seconds

z8d ago

#4037

Serve globally scans definitions twice per new direct-type step, delaying worker dispatch by minutes

z8d ago

#3665

Serve: execute independent webhook-triggered workflows concurrently

z12d ago

#3787

Update public OpenTelemetry manual for remote waterfalls and execution metrics (#3786)

7d ago

#3786

serve/fleet: close OpenTelemetry attribution gaps across dispatch, data plane and worker lifecycle

12d ago

#3755

serve: multi-minute write_resource latency during concurrent worker readiness

z14d ago

#3724

Installers intermittently fail resolving stable release: add bounded retries and actionable diagnostics

14d ago

#3703

Serve: delegate namespace-scoped extension pulls and reload without granting administrator access

14d ago

#3692

README.md needs updating with current language and content

s14d ago

#3679

Preserve active worker execution across serve restarts and upgrades; reconnect and reattach dispatches

15d ago

#3668

Flaky test: lock hand-off timeout test times out in its own setup under load

15d ago

#3661

Dashboard: a hidden tab keeps polling and re-rendering (health stream, live run page)

15d ago

#3656

Registry client: retry transient upstream failures with bounded backoff and visible attempt progress

s15d ago

#3522

Pause and resume a scheduled workflow without editing or deleting its definition

z19d ago

#3519

Remote worker step marked failed ('aborted due to timeout') when the result report times out, though the method succeeded and its data was saved

s19d ago

#3473

Retention: one timeframe, enforced automatically, after which nothing older remains anywhere in the datastore

s19d ago

#3483

Workflow run cancellation on concurrency-key conflict

3d ago

#3405

serve keeps a worker whose enroll finished after the worker timed out, then refuses the real worker as "already connected" and dispatches into the dead session

s21d ago

#3407

workflow run search / history search parse every run record on every call, so their cost grows with all history ever kept

21d ago

#3408

Configurable storage tiers: runs, outputs, data versions and audit move through an ordered list of user-defined tiers, and stay queryable across them

21d ago

#3356

Fleet visibility: live worker host map grouped by label, with slot-level lease state

22d ago

#3403

Docs: dashboard reference needs the Workers view (/dashboard/workers)

21d ago

#3399

serve: the per-IP WebSocket burst limit can't be configured, so workers behind one NAT IP throttle each other

19d ago

#3224

swamp access check run locally ignores the named resource's stored type and tags

s26d ago

#3208

Activity projector fails with ZooKeeper "Bad version" error on swamp.score_grants during keeper instability

26d ago

#2613

extension push: workflows listed with a shared directory prefix collapse into one workflows.yaml; all but the last are silently dropped

s1mo ago

#3002

Cloud Asset: complete metadata-only project search snapshot for lifecycle planning

s1mo ago

#2595

Dashboard: deep links to a model's data item, data version and report

s1mo ago

#2596

swamp report get --version N returns "Report not found" for any version older than the latest

s1mo ago

#2557

serve: `serve reload` drops `export const extension` methods from a pulled package, while other extensions on the same type survive

s1mo ago

#2438

serve: one unresolvable username in `auth.admins` stops the server from starting

s1mo ago

#2437

control-plane vault init failures are swallowed; `access token reveal` says "Vault '_token-secrets' not found"

s1mo ago

#2436

serve: boot token-secret migration deletes the source vault item

1mo ago

#2435

serve: boot hydration ignores `hydrationStrategy: lazy` and downloads every payload

z27d ago

#2223

Security Center: complete location-scoped finding snapshots for current-run reporting

s1mo ago

#2217

IAM service accounts: verified deterministic-account lifecycle method with safe 404/409 handling

s1mo ago

#2227

Secret Manager: complete metadata-only secret/version hygiene snapshot across projects

s1mo ago

#2198

extension push: allow explicit private visibility in the manifest and at publish time, including public collectives

1mo ago

#2228

Swamp Club deno serve stays alive after SIGTERM because background loops are not stopped

1mo ago

#2221

Verification reviews infer pass from Claude usage-limit errors

s1mo ago

#2225

Swamp Club fresh-database startup aborts migrations on missing deviceCode and concurrent replica markers

16d ago

#2222

Logging sinks: convergent audit sink setup with typed writer identity and destination verification

1mo ago

#2220

Org Policy: typed batch effective-policy snapshots for baseline reports

1mo ago

#2215

Recommender: complete multi-scope recommendation snapshot for cost reports

1mo ago

#2214

Billing Budgets: convergent ensure-by-ID-or-unique-name method with etag and notification verification

1mo ago

#2203

Publishing manual contradicts registry omission defaults and supported visibility values

1mo ago

#2213

Service Usage: persist a complete paginated enabled-services snapshot for drift reports

1mo ago

#2207

Resource Manager: recursive caller-visible organisation hierarchy inventory with full pagination

1mo ago

#2200

Registry API: opt-in private visibility at publish time with fully backward-compatible defaults (prerequisite for CLI #2198)

1mo ago

#2202

BigQuery jobs: add a typed query method that polls, paginates and persists query results

1mo ago

#1716

Generic OTLP endpoint appends signal path after query or fragment

s2mo ago

#1696

Cloud Build create supplies project instead of required projectId path parameter

s2mo ago

#1756

Make official Docker image OCI-compliant

s2mo ago

#1715

Issue lifecycle start drops top-level issue comments

2mo ago

#1694

Global Secret Manager methods build an invalid regional parent

s2mo ago

#1703

No way to store code-review results — verdicts, findings, and cost are not persisted for any repo

s13d ago

#1643

Smoke test: gated lab issue lifecycle workflow

2mo ago

#1346

swamp-club: score-reads tierTotals GET overflows URL with inline param_ownerIds (Invalid URL, mislabeled clickhouse-network-error) for large collectives

s3mo ago

#1317

[sc] quest-grant Mongo ops (recentHeartbeat/signalCounts/countIssueShipped) regressed to ~5s timeouts — missing index

s3mo ago

#1249

Telemetry stats consumer: unsanitized subcommand in Mongo update path drops user metrics silently

k3mo ago

#1226

Embeddable operative profile cards (iframe + oEmbed)

s13d ago

#1132

Harden the CLI update path so a future artifact-host migration can't strand clients again

3mo ago

#1131

swamp update silently reports 'up to date' forever if the stable pointer loses its redirect-location metadata

z23d ago

#1071

Slow Mongo: subscription.findByCollectiveId N+1 fan-out inflates p95 (lab issue list)

s3mo ago

#1025

Scorecard: beta/rc-only extensions show "not scored" despite successful scoring (GET /score resolves only latestVersion)

s3mo ago

#843

Make serve WebSocket idle/keepalive timeout configurable (untunable default aborts runs when serve's loop briefly blocks)

s4mo ago

#840

Expose run/job/step identifiers as SWAMP_* env vars + CEL values, and template placement selectors (extends #331's run.id)

1mo ago

#186

Workflow tasks should support ephemeral model instances (modelType + globalArgs) so workflows are zero-prereq

5mo ago

#171

CLI dumps 300-line Cliffy Command object on unknown flags / subcommands

s6mo ago

#164

swamp datastore sync is minutes-slow at 4k-file scale even with zero-diff; outer 300s timeout fires

s6mo ago

#157

swamp extension install: datastore push hangs ~8.5m then crashes with Deno TLS panic (tls_wrap.rs:1918 unwrap on None)

s6mo ago

#123

User extensions silently dropped when base type not yet registered at scan time

s6mo ago

#125

Per-repo user-extension bundle cache doesn't invalidate on source changes

s6mo ago

#124

Adding methods to in-body `methods:{}` on `export const model` doesn't re-register

s6mo ago

← Back to list

01Issue

FeatureClosedExtensionsPublic

AssigneesNone

Relationships

#2202 BigQuery jobs: add a typed query method that polls, paginates and persists query results

Opened by swamp_lord · 9/16/2026

While building a reusable organisation-cost report from GCP billing exports, the installed @swamp/gcp/bigquery/jobs type exposes query and get_query_results, but these methods return an unpersisted result rather than typed data handles. Reports and CEL consumers need durable results from the exact execution. Please add a typed query method that accepts named parameters, location and maximumBytesBilled, waits for job completion, retrieves all result pages, validates errors and response shape, and persists results plus job provenance. Bounded result limits should fail or explicitly report truncation, never silently present incomplete totals. We are extending this existing model locally with a specialised billing-export query method in the meantime.

Upstream repository: https://github.com/swamp-club/swamp-extensions

Environment

Extension: @swamp/gcp/bigquery@2026.09.15.1
swamp: 20260911.215321.0-sha.d18f2d86
OS: darwin (aarch64)
Deno: 2.9.6
Shell: /bin/zsh

02Bog Flow

Closed

9/17/2026, 11:25:24 PM

No activity in this phase yet.

03Sludge Pulse

stack72 commented 9/17/2026, 11:25:23 PM

Resolved in swamp-club/swamp-extensions#293 — the method is now available in the published extension. Upgrade to version 2026.09.17.1 (or .2 for bigquery) to pick it up.

Package everything on ops.swamp-club.com; stop direct server edits

artifacts.swamp-club.com unreachable in Spain during LaLiga matches (ISP blocking of Cloudflare IPs)

Shared dispatch bookkeeping queue delays completed worker results by up to 58 seconds

Serve globally scans definitions twice per new direct-type step, delaying worker dispatch by minutes

Serve: execute independent webhook-triggered workflows concurrently

Update public OpenTelemetry manual for remote waterfalls and execution metrics (#3786)

serve/fleet: close OpenTelemetry attribution gaps across dispatch, data plane and worker lifecycle

serve: multi-minute write_resource latency during concurrent worker readiness

Installers intermittently fail resolving stable release: add bounded retries and actionable diagnostics

Serve: delegate namespace-scoped extension pulls and reload without granting administrator access

README.md needs updating with current language and content

Preserve active worker execution across serve restarts and upgrades; reconnect and reattach dispatches

Flaky test: lock hand-off timeout test times out in its own setup under load

Dashboard: a hidden tab keeps polling and re-rendering (health stream, live run page)

Registry client: retry transient upstream failures with bounded backoff and visible attempt progress

Pause and resume a scheduled workflow without editing or deleting its definition

Remote worker step marked failed ('aborted due to timeout') when the result report times out, though the method succeeded and its data was saved

Retention: one timeframe, enforced automatically, after which nothing older remains anywhere in the datastore

Workflow run cancellation on concurrency-key conflict

serve keeps a worker whose enroll finished after the worker timed out, then refuses the real worker as "already connected" and dispatches into the dead session

workflow run search / history search parse every run record on every call, so their cost grows with all history ever kept

Configurable storage tiers: runs, outputs, data versions and audit move through an ordered list of user-defined tiers, and stay queryable across them

Fleet visibility: live worker host map grouped by label, with slot-level lease state

Docs: dashboard reference needs the Workers view (/dashboard/workers)

serve: the per-IP WebSocket burst limit can't be configured, so workers behind one NAT IP throttle each other

swamp access check run locally ignores the named resource's stored type and tags

Activity projector fails with ZooKeeper "Bad version" error on swamp.score_grants during keeper instability

extension push: workflows listed with a shared directory prefix collapse into one workflows.yaml; all but the last are silently dropped

CLI tells signed-in callers to sign in when the registry rate-limits them

Add a subprocessors page at /subprocessors

Make Compute Routes list usable without create-only global arguments

Cloud Asset: complete metadata-only project search snapshot for lifecycle planning

Dashboard: deep links to a model's data item, data version and report

swamp report get --version N returns "Report not found" for any version older than the latest

serve: `serve reload` drops `export const extension` methods from a pulled package, while other extensions on the same type survive

serve: one unresolvable username in `auth.admins` stops the server from starting

control-plane vault init failures are swallowed; `access token reveal` says "Vault '_token-secrets' not found"

serve: boot token-secret migration deletes the source vault item

serve: boot hydration ignores `hydrationStrategy: lazy` and downloads every payload

Security Center: complete location-scoped finding snapshots for current-run reporting

IAM service accounts: verified deterministic-account lifecycle method with safe 404/409 handling

Secret Manager: complete metadata-only secret/version hygiene snapshot across projects

extension push: allow explicit private visibility in the manifest and at publish time, including public collectives

Swamp Club deno serve stays alive after SIGTERM because background loops are not stopped

Verification reviews infer pass from Claude usage-limit errors

Swamp Club fresh-database startup aborts migrations on missing deviceCode and concurrent replica markers

Logging sinks: convergent audit sink setup with typed writer identity and destination verification

Org Policy: typed batch effective-policy snapshots for baseline reports

Recommender: complete multi-scope recommendation snapshot for cost reports

Billing Budgets: convergent ensure-by-ID-or-unique-name method with etag and notification verification

Publishing manual contradicts registry omission defaults and supported visibility values

Service Usage: persist a complete paginated enabled-services snapshot for drift reports

Resource Manager: recursive caller-visible organisation hierarchy inventory with full pagination

Registry API: opt-in private visibility at publish time with fully backward-compatible defaults (prerequisite for CLI #2198)

BigQuery jobs: add a typed query method that polls, paginates and persists query results

Generic OTLP endpoint appends signal path after query or fragment

Cloud Build create supplies project instead of required projectId path parameter

Make official Docker image OCI-compliant

Issue lifecycle start drops top-level issue comments

Global Secret Manager methods build an invalid regional parent

No way to store code-review results — verdicts, findings, and cost are not persisted for any repo

Smoke test: gated lab issue lifecycle workflow

swamp-club: score-reads tierTotals GET overflows URL with inline param_ownerIds (Invalid URL, mislabeled clickhouse-network-error) for large collectives

[sc] quest-grant Mongo ops (recentHeartbeat/signalCounts/countIssueShipped) regressed to ~5s timeouts — missing index

Telemetry stats consumer: unsanitized subcommand in Mongo update path drops user metrics silently

Embeddable operative profile cards (iframe + oEmbed)

Harden the CLI update path so a future artifact-host migration can't strand clients again

swamp update silently reports 'up to date' forever if the stable pointer loses its redirect-location metadata

Slow Mongo: subscription.findByCollectiveId N+1 fan-out inflates p95 (lab issue list)

Scorecard: beta/rc-only extensions show "not scored" despite successful scoring (GET /score resolves only latestVersion)

Make serve WebSocket idle/keepalive timeout configurable (untunable default aborts runs when serve's loop briefly blocks)

Expose run/job/step identifiers as SWAMP_* env vars + CEL values, and template placement selectors (extends #331's run.id)

Workflow tasks should support ephemeral model instances (modelType + globalArgs) so workflows are zero-prereq

CLI dumps 300-line Cliffy Command object on unknown flags / subcommands

swamp datastore sync is minutes-slow at 4k-file scale even with zero-diff; outer 300s timeout fires

swamp extension install: datastore push hangs ~8.5m then crashes with Deno TLS panic (tls_wrap.rs:1918 unwrap on None)

User extensions silently dropped when base type not yet registered at scan time

Per-repo user-extension bundle cache doesn't invalidate on source changes

Adding methods to in-body `methods:{}` on `export const model` doesn't re-register

Relationships