Skip to content

feat(meta): add agent-review rubric and example GitHub Action#1209

Draft
jfindlay wants to merge 1 commit into
leanprover-community:masterfrom
jfindlay:AI-Policy
Draft

feat(meta): add agent-review rubric and example GitHub Action#1209
jfindlay wants to merge 1 commit into
leanprover-community:masterfrom
jfindlay:AI-Policy

Conversation

@jfindlay

Copy link
Copy Markdown
Contributor
  • AGENTS-REVIEW.md: A vendor-neutral, rubric for a single review pass on a Physlib PR.
  • .github/workflows/agent-review.yml: An example implementation triggered by the agent-review label.

* `AGENTS-REVIEW.md`: A vendor-neutral, rubric for a single review pass
  on a Physlib PR.
* `.github/workflows/agent-review.yml`: An example implementation
  triggered by the `agent-review` label.

Co-authored-by: Claude Sonnet 4.6 <noreply+claude-sonnet@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thank you for this PR, which will now be reviewed.
If submitting to ./Physlib or ./QuantumInfo, please
see our review guidelines
if you are not familiar with the process. You should expect a back and forth
with a reviewer before your PR is merged. See also that link for how to
add appropriate labels to your PR. The PR will also go through a number
of automated checks. You can learn more about these here,
including how to run them locally.

If you are submitting to ./PhyslibAlpha there will be a lighter review process,
though your PR must still pass the automated checks.

If you want to bring attention to this PR, please write a message on this
thread of the Lean Zulip.

AGENT_REVIEW_API_KEY: ${{ secrets.AGENT_REVIEW_API_KEY }}
# Configure the model here. Default: a mid-tier model.
# Escalate to a top-tier model only for large or complex PRs by exception.
AGENT_MODEL: "claude-sonnet-4-5"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sonnet 4.5 is not good enough. I think we should use the top tier models here like opus-4.8 or gpt-5.5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants