Skip to content

fix(classifier): flag success claimed with zero verifications - #24

Open
rune-oai wants to merge 2 commits into
loop-eng:mainfrom
rune-oai:fix/8-false-complete-no-verify
Open

rune-oai wants to merge 2 commits into
loop-eng:mainfrom
rune-oai:fix/8-false-complete-no-verify

Conversation

@rune-oai

Copy link
Copy Markdown

Summary

detectFalseCompletion returned nil when a loop claimed success (goal_met / terminate) but never ran any verification. That case is suspicious and should be flagged.

When lastVerify is nil and success was claimed, return CatFalseComplete at confidence 0.60 with evidence that no verification was performed.

Fixes #8

Test plan

  • go test ./internal/classifier/ -run FalseCompletion -count=1
  • Existing fail-then-claim-success case still passes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

False completion undetected when trace has zero verification events

1 participant