secret-digger-claude: switch to Haiku, lower max-turns to 4#1956
Conversation
…s to 4 - Add GH_AW_MODEL_AGENT_CLAUDE env override to use claude-haiku-4-5-20251001 (workflow-scoped, does not affect other Claude workflows) - Reduce max-turns from 8 to 4 (actual usage is always 3 turns) - Recompile lock file to reflect these changes Expected impact: -96% cost/run ($0.51 → ~$0.018) Agent-Logs-Url: https://github.com/github/gh-aw-firewall/sessions/b2159c34-4a33-4d0d-a898-469353139ffd Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
|
@copilot resolve the merge conflicts in this pull request |
…de-token-usage-again # Conflicts: # .github/workflows/secret-digger-claude.lock.yml Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Resolved in bbd10ac. The conflict was in the lock file — main added |
This comment has been minimized.
This comment has been minimized.
✅ Coverage Check PassedOverall Coverage
📁 Per-file Coverage Changes (1 files)
Coverage comparison generated by |
Smoke Test Results
Overall: PASS
|
🔥 Smoke Test Results
Overall: PASS
|
Smoke Test: GitHub Actions Services Connectivity ✅All checks passed:
Note:
|
This comment has been minimized.
This comment has been minimized.
🏗️ Build Test Suite Results
Overall: 8/8 ecosystems passed — ✅ PASS
|
This comment has been minimized.
This comment has been minimized.
|
🔮 The ancient spirits stir; this smoke-test agent has passed through the firewall paths and marked this run in the ledger of signals.
|
There was a problem hiding this comment.
Pull request overview
This PR reduces operational cost for the Secret Digger (Claude) workflow by switching its Claude model to Haiku and lowering the configured max-turns limit to better match observed usage.
Changes:
- Lower
engine.max-turnsfrom 8 → 4 for the Secret Digger (Claude) workflow. - Add a workflow-scoped
GH_AW_MODEL_AGENT_CLAUDEoverride to pin the agent model toclaude-haiku-4-5-20251001. - Recompile the corresponding
*.lock.ymlto reflect the new max-turns and model override in generated job env/commands.
Show a summary per file
| File | Description |
|---|---|
| .github/workflows/secret-digger-claude.md | Lowers max-turns and pins the workflow’s Claude agent model to Haiku via engine.env. |
| .github/workflows/secret-digger-claude.lock.yml | Regenerated lock file reflecting --max-turns 4 and the pinned GH_AW_MODEL_AGENT_CLAUDE in the workflow jobs. |
Copilot's findings
Tip
Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
- Files reviewed: 2/2 changed files
- Comments generated: 1
| DISABLE_BUG_COMMAND: 1 | ||
| DISABLE_ERROR_REPORTING: 1 | ||
| DISABLE_TELEMETRY: 1 | ||
| GH_AW_MODEL_AGENT_CLAUDE: claude-haiku-4-5-20251001 |
There was a problem hiding this comment.
In the detection job’s Execute Claude Code CLI step, GH_AW_MODEL_AGENT_CLAUDE is set in env, but the command only references GH_AW_MODEL_DETECTION_CLAUDE for --model. Consider removing GH_AW_MODEL_AGENT_CLAUDE here (or, if the intent is to pin the detection model too, set GH_AW_MODEL_DETECTION_CLAUDE instead) to avoid confusion about which model the detection run uses.
| GH_AW_MODEL_AGENT_CLAUDE: claude-haiku-4-5-20251001 |
Secret Digger (Claude) accounts for 63% of total Claude spend ($10.71/21 runs) due to Sonnet 4.6 cache write charges (~$0.43/run) that provide no cross-run benefit — Anthropic's 5-minute cache TTL vs. hourly schedule means every run pays full cold-cache cost.
Changes
secret-digger-claude.mdmax-turns: 8→4(actual usage is always 3; this is a runaway guard, not a functional limit)GH_AW_MODEL_AGENT_CLAUDE: "claude-haiku-4-5-20251001"inengine.env— workflow-scoped override, does not affectsmoke-claudeorsecurity-guardsecret-digger-claude.lock.yml— recompiled + post-processed; reflects--max-turns 4andGH_AW_MODEL_AGENT_CLAUDE: claude-haiku-4-5-20251001in the agent job envExpected impact
Haiku is well-suited to this task (bash-heavy read-only shell forensics). The task structure and
cache-memorypersistence are unchanged.