Skip to content

review: confident-wrong pass — judge the change as a whole, not just its lines#38

Merged
Octember merged 2 commits into
mainfrom
review/confident-wrong-pass
Jun 30, 2026
Merged

review: confident-wrong pass — judge the change as a whole, not just its lines#38
Octember merged 2 commits into
mainfrom
review/confident-wrong-pass

Conversation

@Octember

Copy link
Copy Markdown
Owner

The rubric + prompt were entirely line-level and corpus-citable (bug / type-lie / dead-code / footgun / reinvents-primitive / local over-abstraction), and the precision rule drops anything not tied to a primitive or a provable defect. So confident-wrong slop — wrong premise, overbuilt approach, a hollow no-op — sailed through: no single bad line, and a polished diff actively bought a pass.

This adds:

  • a holistic confident-wrong pass (first): judge the change as a whole — does it need to exist, simplest at the right owner, does it do what it claims — hyper-skeptical of confident code, exempt from the line-level suppression.
  • three rubric kinds: wrong-premise / overbuilt / confident-noop, flaggable on confidence without a corpus citation.

Already live on the bevyl.ai + bunion review VMs (copied to each ~/.stupify/.review/); this PR lands the source.

🤖 Generated with Claude Code

… just its lines

The rubric + prompt were entirely line-level and corpus-citable (bug / type-lie / dead-code / footgun /
reinvents-primitive / local over-abstraction), and the precision rule drops anything not tied to a primitive
or a provable defect. So confident-wrong slop — wrong premise, overbuilt approach, hollow no-op — sailed
through: no single bad line, and a polished diff actively bought a pass.

Add a holistic FIRST pass that attacks the change itself (does it need to exist? simplest at the right owner?
does it do what it claims?), hyper-skeptical of confident code, EXEMPT from the line-level suppression; plus
three rubric kinds (wrong-premise / overbuilt / confident-noop) flaggable on confidence without a citation.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

@exe-dev-github-integration exe-dev-github-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hm, one real issue in the prompt contract.

Comment thread .review/REVIEW-PROMPT.md
stupify (PR #38) caught the contract gap: the new whole-change kinds are exempt from corpus citation, but the
comment format still required every fix line to end with (<reference file>) — forcing an invented citation or
a broken output shape. Make the parenthetical conditional: keep it for corpus-cited findings, omit it for
overbuilt / wrong-premise / confident-noop.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

@exe-dev-github-integration exe-dev-github-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice, all fixed ✅

@Octember Octember merged commit 3ce7b97 into main Jun 30, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant