You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
agent_outcome telemetry has empty reason/final_tool/error_class for ~30% of builder runs #765
Telemetry analysis (2026-04-28, last 7 PDT days) shows the agent_outcome event ships with reason, final_tool, and error_class all empty. About 30% of builder runs end with outcome ∈ {abandoned, aborted, error}, so today ~30% of builder failures are undiagnosable from telemetry alone.
Concretely, builder completion rate has been stuck at 62-69% week-over-week, but we can't tell why failures happen without falling back to per-session trace inspection.
Apply maskString symmetrically to both error and aborted reasons
Telemetry contract
Post-fix, agent_outcome events will include three required string fields:
final_tool: name of last tool invoked (empty if none)
error_class: classification (file_not_found, connection, timeout, etc.) or empty
reason: short masked diagnostic snippet, or "no_tools_invoked" / "user_cancelled" / ""
Privacy
error.data for variants like APIError carries responseBody, responseHeaders, metadata — provider auth tokens, raw response bodies, request URLs. The fix extracts only error.data.message (human-readable) and runs maskString at the extraction site to prevent any leak vector.
Closing as fixed on main: agent_outcome now tracks the last tool and derives reason, final tool and error class (session/prompt.ts); the contract is documented in docs/reference/telemetry.md. Please reopen if you still see this on v0.12.9 or later.
Activity
anandgupta42 commentedon Nov 5, 2026
Closing as fixed on
main:agent_outcomenow tracks the last tool and derives reason, final tool and error class (session/prompt.ts); the contract is documented indocs/reference/telemetry.md. Please reopen if you still see this on v0.12.9 or later.