[None][perf] optimize encoder-decoder PyTorch performance - #16706

Merged

cascade812 merged 22 commits into

NVIDIA:mainfrom

cascade812:guiju/encoder-decoder-perf

Aug 9, 2026

Commits on Jul 21, 2026

[None][perf] accumulate encoder work during decode
cascade812
committed
1cc01f1
[None][perf] prepare mixed decoder batches natively
cascade812
committed
6fd8dc8

Commits on Jul 22, 2026

[None][perf] reuse stable greedy sampling metadata
cascade812
committed
433dcb9

Commits on Jul 26, 2026

[None][perf] optimize BART encoder-decoder execution
cascade812
committed
f3a8e10

Commits on Jul 29, 2026

Commits on Jul 30, 2026

[None][perf] improve encoder-decoder CUDA graph handling
cascade812
committed
04ca506
[None][fix] stabilize encoder-decoder CUDA graph capture
cascade812
committed
4f981ac
Merge origin/main into guiju/encoder-decoder-perf
cascade812
committed
0c32c18

Commits on Jul 31, 2026

Commits on Aug 1, 2026

address comments
cascade812
committed
bb70aab
Merge remote-tracking branch 'origin/main' into guiju/encoder-decoder-perf
cascade812
committed
a2a73ce

Commits on Aug 3, 2026

Merge branch 'main' into guiju/encoder-decoder-perf
cascade812
authored
b68b955
address comment
cascade812
committed
15b2d67

Commits on Aug 4, 2026

fix failed tests
cascade812
committed
b7b15eb
address failed tests
cascade812
committed
477ac44

Commits on Aug 5, 2026

address comments
cascade812
committed
47b0116
Merge remote-tracking branch 'origin/main' into guiju/encoder-decoder-perf
cascade812
committed
01ae2d2

Commits on Aug 6, 2026

fix failed test
cascade812
committed
42c8bff

Commits on Aug 7, 2026

address comment
cascade812
committed
0789f21
Merge branch 'main' into guiju/encoder-decoder-perf
cascade812
authored
51f1037