Skip to content

feat(issue-53): MoA boundary test completion + coverage to 97% - #160

Open
H2Rhan wants to merge 4 commits into
Tencent:mainfrom
H2Rhan:issue-53-moa-boundary-tests
Open

feat(issue-53): MoA boundary test completion + coverage to 97%#160
H2Rhan wants to merge 4 commits into
Tencent:mainfrom
H2Rhan:issue-53-moa-boundary-tests

Conversation

@H2Rhan

@H2Rhan H2Rhan commented Jul 22, 2026

Copy link
Copy Markdown

Closes #53
Systematic boundary tests (+30 tests, 95 total):

  • NeckMoAFusion cross-scale size mismatch (64x upsample, non-square)
  • MoABlock temperature gradient at temp < 1e-8 (no NaN, no grad explosion)
  • _safe_groups boundary with prime channel dims (17/19/23/29/31/37/41)
  • C2fMoA aux_loss anti-double-count in triple nesting
  • FP16/BF16 linear attention path, DDP reduce path, error paths

Coverage: 85% -> 97% (ultralytics/nn/modules/moa/)
Training: CPU pipeline validated, VisDrone GPU training script ready

H2Rhan added 3 commits July 22, 2026 22:06
Systematic boundary tests (+30 tests, 95 total):
- NeckMoAFusion cross-scale size mismatch (64x upsample, non-square)
- MoABlock temperature gradient at temp < 1e-8 (no NaN, no grad explosion)
- _safe_groups boundary with prime channel dims (17/19/23/29/31/37/41)
- C2fMoA aux_loss anti-double-count in triple nesting
- FP16/BF16 linear attention path, DDP reduce path, error paths

Coverage: 85% -> 97% (ultralytics/nn/modules/moa/)
Training: CPU pipeline validated, VisDrone GPU training script ready
…aseline on VisDrone)

MoA 50 epochs, Baseline 37 epochs, RTX 5070 Laptop
MoA mAP50: 0.1923, mAP50-95: 0.1021
Baseline mAP50: 0.1868, mAP50-95: 0.0998
MoA 50ep mAP50: 0.1923, mAP50-95: 0.1021
Baseline 37ep mAP50: 0.1868, mAP50-95: 0.0998
@H2Rhan
H2Rhan force-pushed the issue-53-moa-boundary-tests branch from 868a7f9 to 7df7feb Compare July 23, 2026 01:37
MoA (50ep):  mAP50=0.1923, mAP50-95=0.1021
Baseline (50ep): mAP50=0.1982, mAP50-95=0.1065
Baseline MoE slightly outperforms MoA at VisDrone 50ep
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2026犀牛鸟开源人才专属】【低难度】MoA(mixture of Attention):边界测试补全与垂类训练验证

1 participant