Replies: 1 comment
-
|
可以配置 Langfuse 的环境变量并在 Langfuse 上查看,看一下是否满足需求 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
你好,我注意到当前 Agent eval 路径会返回最终输出和 trace id,但缺少工具调用轨迹的轻量摘要。由于 run events 里已经包含工具调用、错误和中断信息,我想提议为
/agent-invocation/eval/runs增加一个可选能力:在请求时返回trajectory_summary,包含工具名称、调用次数、错误次数、中断次数和事件元数据。这个改动不会改变默认 API/CLI 行为,也暂时不持久化完整轨迹。请问这类 eval 可观测性增强 PR 是否有价值?或者你们已经有 Agent eval metrics 的相关计划?
Beta Was this translation helpful? Give feedback.
All reactions