Skip to content

Agent: fix success count logic in extraction scripts to match actual log markers#722

Merged
luotao1 merged 1 commit into
PaddlePaddle:developfrom
luotao1:script-update
May 21, 2026
Merged

Agent: fix success count logic in extraction scripts to match actual log markers#722
luotao1 merged 1 commit into
PaddlePaddle:developfrom
luotao1:script-update

Conversation

@luotao1
Copy link
Copy Markdown
Collaborator

@luotao1 luotao1 commented May 21, 2026

PR Category

Description

问题描述

analyze_extraction_log.shcheck_extraction_progress.sh 两个辅助脚本的成功数统计逻辑与 Agent 代码实际打印的日志标记不一致,导致统计结果严重低估。

脚本 修改前 实际日志标记
check_extraction_progress.sh "Successfully extracted" "Graph extracted to"
analyze_extraction_log.sh "\[CPU X\] OK" "Graph extracted to"

Agent 代码在成功抽取后的实际日志输出是 "Graph extracted to: /path/to/sample"(见 graph_net_agent.py),旧统计方式遗漏了绝大部分成功记录。

影响:以 batch7_safe_run_no_llm.log 为例,旧逻辑统计成功数仅 283 个,与实际日志中的 4,691"Graph extracted to" 记录严重不符。

修改内容

脚本 修改项 修改前 修改后
check_extraction_progress.sh 成功数统计 grep -c "Successfully extracted" grep -c "Graph extracted to"
check_extraction_progress.sh 总尝试数条件 "Successfully extracted" "Graph extracted to"
analyze_extraction_log.sh 成功数统计 grep "\[(CPU|GPU) [0-9]+\] OK" grep -ac "Graph extracted to"
analyze_extraction_log.sh 成功列表生成 "OK" 提取 "Graph extracted to" 提取

同时更新了脚本头部注释,说明当前日志使用的实际标记格式。

验证结果

# batch7_safe_run_no_llm.log
旧逻辑: 成功 283 个,成功率 1.3%
新逻辑: 成功 4,691 个,成功率 21.6%

与日志中 "Graph extracted to" 的实际出现次数(4,691)完全一致。

…log markers

- analyze_extraction_log.sh:
  - Success count: change from '[CPU X] OK' to 'Graph extracted to' (actual marker in code)
  - Success model list: also extract from 'Graph extracted to'
  - Update comments to reflect actual log marker format

- check_extraction_progress.sh:
  - Success count: change from 'Successfully extracted' to 'Graph extracted to'
  - Total attempts condition: sync to match new marker

The main success log output is 'INFO - Graph extracted to: ...', not
'Successfully extracted' or '[CPU X] OK'. Old logic missed most success records.

Example (batch7_safe_run_no_llm.log):
  - Old logic: 283 successes
  - New logic: 4,691 successes
@paddle-bot
Copy link
Copy Markdown

paddle-bot Bot commented May 21, 2026

Thanks for your contribution!

@luotao1 luotao1 merged commit 1d053c8 into PaddlePaddle:develop May 21, 2026
3 checks passed
@luotao1 luotao1 deleted the script-update branch May 21, 2026 03:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants