Skip to content

feat(verify): add KNOWN-GAP bucket waived by approved decision records - #10

Merged
avrabe merged 1 commit into
mainfrom
feat/verify-known-gap-bucket
Nov 13, 2026
Merged

avrabe merged 1 commit into
mainfrom
feat/verify-known-gap-bucket

Conversation

@avrabe

@avrabe avrabe commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Main has been red since #2 merged (2026-11-02). Four surface tests fail for COMP-REQ-KVS-KEY-NAMING and COMP-REQ-KVS-KEY-LENGTH because vendored eclipse rust_kvs accepts keys containing space, . and / and keys longer than 32 bytes. Dependabot PRs #8 and #9 are red only because they inherit this.

Change

  • tools/verify.py: a FAILED comp-req becomes KNOWN-GAP (exit 0) when an approved decision-record tagged known-gap links satisfies to it. If every test on a waived comp-req passes, it becomes STALE-GAP (exit 1) until the waiver is removed. MISSING cannot be waived. .verify-output.json gains known_gap and stale_gap.
  • artifacts/safety-and-decisions.yaml: DR-KVS-KEY-VALIDATION-GAP waives the two key comp-reqs.
  • README.md: the finding section now shows the KNOWN-GAP output and documents the waiver rules.

Evidence (local, real bazel)

Command Exit Buckets
make verify (dev) 0 3 PASSED, 2 KNOWN-GAP
verify.py --variant prod 1 1 MISSING (INLINE-STORAGE), 2 KNOWN-GAP
verify.py with a scratch waiver on passing KEY-ENCODING 1 1 STALE-GAP

I have not run rivet validate on the new decision record locally because the rivet shim is not configured on this machine. CI's make validate is the first schema check.

🤖 Generated with Claude Code

https://claude.ai/code/session_01KEjmjapTTSvsFZti3qcD56

Main has been red since #2 (2026-11-02) on four surface tests for
COMP-REQ-KVS-KEY-NAMING and COMP-REQ-KVS-KEY-LENGTH: vendored rust_kvs
accepts keys with space, '.', '/' and keys over 32 bytes. That red hid
every other regression, including dependabot PRs #8 and #9.

verify.py now reports a FAILED comp-req as KNOWN-GAP (exit 0) when an
approved decision-record tagged known-gap links satisfies to it. A
waived comp-req whose tests all pass is STALE-GAP (exit 1). MISSING is
never waivable. DR-KVS-KEY-VALIDATION-GAP waives the two key comp-reqs.

Local runs:
  make verify                       exit 0: 3 PASSED, 2 KNOWN-GAP
  verify.py --variant prod          exit 1: 1 MISSING (INLINE-STORAGE)
  verify.py with a waiver on KEY-ENCODING (passing) exit 1: 1 STALE-GAP

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01KEjmjapTTSvsFZti3qcD56
@avrabe
avrabe merged commit 8b92f1e into main Nov 13, 2026
1 check passed
@avrabe
avrabe deleted the feat/verify-known-gap-bucket branch November 13, 2026 05:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant