Skip to main content
← Back to list
01Issue
BugShippedSwamp CLIPublic
AssigneesNone

Relationships

↔ sibling #4781

#4738 Flaky: datastore_v3_replica_verify_test times out waiting for the sidecar's verdict when restarting a broken lineage under a live sidecar

Opened by stack72 · 11/14/2026· Shipped 11/16/2026

What fails

  • Test: integration/datastore_v3_replica_verify_test.ts, "v3 replica check: a write that restarts a broken lineage under a live sidecar starts Litestream afresh, though the old lineage's first L0 files expired (swamp-club#3935)".
  • Error: waitFor: timed out after 20000ms waiting for the sidecar to record its verdict for the acknowledged TXID, thrown from plantBrokenVerdict (integration/datastore_v3_litestream_helpers.ts). The test ran 22 s.

Where it was seen

It failed in 3 of 537 verify-build runs in the main checkout's workflow history, on three unrelated branches:

Branch Commit Run Date
4276 b874cb0f5c 038731df-75d3-4a0c-8038-aff3cb747397 2026-11-02
4290 ffa2be8894 d790491d-d46c-42eb-bd66-a4a4b63d51c9 2026-11-02
4702 7344249b89 015e564a-f5d4-4d72-be0d-530d348b412c 2026-11-14

On 4702 it passed in the previous verify-build round and in two local full-suite runs with a real Litestream binary. Each failing run had verify-reviews and verify-skills running alongside it.

Not established

  • Whether the 20 s bound is just too tight for the sidecar's replica check under parallel load, or whether there's a real sidecar bug where the verdict for the acknowledged TXID is never written in some ordering. #4541's similar-looking sidecar flake turned out to be a real supervisor bug.
  • How to reproduce it deterministically. A first step would be injecting a delay into the sidecar's verify check, or holding the replica's L0 listing.

Expected

The sidecar records its verdict for the acknowledged TXID within the bound every time, or the test waits on an event rather than a fixed 20 s.

02Bog Flow
✓OPEN✓TRIAGED✓IN PROGRESS✓SHIPPEDLINKED+ 3 MOREPR_LINKED+ 1 MORESESSION_SUMMARIZED

Shipped

11/16/2026, 4:37:20 AM

Click a lifecycle step above to view its details.

03Sludge Pulse
stack72 linked sibling of #478111/16/2026, 3:31:57 AM

Sign in to post a ripple.