[issue10] NCCL 通信算法选择器:CSV 离线标定、区间压缩与混合负载评估 - #33
Open
shsaihdsaiudh wants to merge 1 commit into
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
关联 Issue
#10
提交内容
src/code/issue10/selector_2026.py:集合通信算法的离线标定 + 在线查表选择器。输入为标定 CSV:
处理流程:
collective × topology × world_size × message_bytes点选出最快的算法 × 协议组合;验证
python -m pytest src/code/issue10/test_selector_2026.py -q # 2 passed python src/code/issue10/selector_2026.py --synthetic-demo合成数据可复现出预期的三段切换结构:小消息 Tree、中消息 Ring、大消息 NVLS。结果写入
src/code/issue10/results-2026/(选择表 + 混合负载评估)。接入真机标定数据时,把
nccl-tests在目标拓扑上的采集结果整理成上述 CSV,直接:当前边界
本 PR 提交的是验收要求 2 的选择器实现(离线标定 + 在线按消息大小/规模查表)。
results-2026/synthetic_calibration.csv是合成标定数据,文件内已显式标注,仅用于验证选择器逻辑,不构成任何性能结论。验收要求 1(各原语在"算法 × 协议 × message size × 拓扑规模"维度上的真实标定数据)需要在含 NVSwitch 的目标拓扑上用
nccl-tests采集;提交者当前为单卡环境,无 NVSwitch,无法采集。另外说明:最终收益验证必须使用独立于标定集的混合消息 trace,避免用标定数据自证收益——这一点已写入 README,真机阶段需要遵守。