Skip to content

Review PRs with Opus 5.5 #12

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
bbertucc merged 1 commit into from
Oct 4, 2026
Merged

Review PRs with Opus 5.5 #12

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/code-review.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -407,7 +407,7 @@ jobs:
# display_report unset: it would double-submit alongside `gh pr review`.
claude_args: >-
--allowedTools Bash(*),Read(*),Glob,Grep
--model ${{ vars.BEDROCK_REVIEW_MODEL || 'us.anthropic.claude-opus-5' }}
--model ${{ vars.BEDROCK_REVIEW_MODEL || 'us.anthropic.claude-opus-5-5' }}
prompt: |
You are an adversarial code reviewer for **equalify-iris-pdf**, reviewing
PR #${{ steps.ctx.outputs.pr_number }} (head ${{ steps.ctx.outputs.head_sha }}) in
Expand Down
11 changes: 4 additions & 7 deletions docs/models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,16 +65,13 @@ On 2026-09-24, through Bedrock `us.` profiles, with the prompt in `src/review/re

The review sends each page's image and its text to the model provider, so do not use it on documents that must not leave your machine.

## The PR reviewer: Opus 5, moving to Opus 5.5
## The PR reviewer: Opus 5.5

`.github/workflows/code-review.yml` runs Claude Code on Bedrock. Its model is the repository variable `BEDROCK_REVIEW_MODEL`, and defaults to `us.anthropic.claude-opus-5`.
`.github/workflows/code-review.yml` runs Claude Code on Bedrock. Its model is the repository variable `BEDROCK_REVIEW_MODEL`, and defaults to `us.anthropic.claude-opus-5-5`.

Over its last 18 successful runs, a review cost $0.30 to $2.67, **$1.44 on average**, in 7 to 30 turns taking 1 to 10 minutes. Claude Code reports these figures at list price, so on the `us.` profile add about 10%. Each push to a PR is reviewed again, so a PR that takes several rounds costs several reviews.
On Opus 5, over 18 successful runs, a review cost $0.30 to $2.67, **$1.44 on average**, in 7 to 30 turns taking 1 to 10 minutes. Opus 5.5's list price is 20% lower, so expect about $1.15. Claude Code reports these figures at list price, so on the `us.` profile add about 10%. Each push to a PR is reviewed again, so a PR that takes several rounds costs several reviews.

**Recommended: Opus 5.5.** It is newer, and its list price is 20% lower, so a review would cost about $1.15 on average. To switch:

1. Add `us.anthropic.claude-opus-5-5` to the review role's Bedrock policy (`equalify-iris-gha-bedrock-review`, policy `bedrock-invoke-opus5`). It needs the inference profile ARN plus the `anthropic.claude-opus-5-5` foundation-model ARNs in its regions, as the policy has for Opus 5.
2. Set the repository variable `BEDROCK_REVIEW_MODEL` to `us.anthropic.claude-opus-5-5`.
The review role (`equalify-iris-gha-bedrock-review`, shared with equalify-iris) allows Opus 5 in policy `bedrock-invoke-opus5` and Opus 5.5 in `bedrock-invoke-opus5-5`: the inference profile ARN plus the foundation-model ARNs in its regions. Another model needs the same.

Keep review on an Opus model. Its job is to find what the author missed, and that is where the cheaper models are weakest.

Expand Down
Loading