Skip to main content
← Back to list
01Issue
BugShippedSwamp CLIPublic
Assigneesstack72

Relationships

#2221 Verification reviews infer pass from Claude usage-limit errors

Opened by swamp_lord · 9/16/2026· Shipped 9/16/2026

Observed while verifying Lab #2198 on commit 3eff93b6 (verification workflow inherited from main 93897fc2). verification/workflow-verify-reviews.yaml runs claude -p through tee, then accepts missing VERDICT when no blocking-finding words match. Actual output: "You have hit your weekly limit" (rendered by Claude as "You\u0027ve hit your weekly limit · resets 4pm (America/Los_Angeles)") followed by ":⚠️:No VERDICT marker found; inferred pass (no blocking findings detected)". The code-review step was marked succeeded although no review ran. Reproduction: exhaust Claude quota, then run verify-reviews with a valid commit/branch. Expected: execution/auth/quota errors and missing review content must fail the review, with no successful attestation. Actual run 3bb3122a-ab69-4381-99ea-f90720b6ef5a code-review duration 2529ms reports success. Please preserve the claude pipeline exit status and distinguish a completed passing review from provider errors before any no-marker fallback. This is unrelated to publication visibility and was not changed in the feature branch.

02Bog Flow
OPENTRIAGEDIN PROGRESSSHIPPED+ 1 MOREASSIGNED+ 2 MOREREVIEW+ 7 MOREPR_MERGED+ 2 MORESESSION_SUMMARIZED

Shipped

9/16/2026, 11:08:10 PM

Click a lifecycle step above to view its details.

03Sludge Pulse
stack72 assigned stack729/16/2026, 10:42:45 PM
Editable. Press Enter to edit.

stack72 commented 9/16/2026, 11:08:17 PM

Thanks @swamp_lord for reporting this! We shipped: Add provider error detection to the verification review workflow. Before the VERDICT inference fallback runs, check the claude -p exit code and scan for known provider error patterns (usage limits, rate limits, auth failures, overload) in the output. If either check fails, fail the review immediately. Fixes the regression where usage-limit errors were inferred as passing reviews.. The fix has been merged and a release is on its way. We appreciate your contribution to swamp.

Sign in to post a ripple.