Skip to content

Fix shape mismatch on the masked_tokens param in decoder masked multi-head attention kernel.#773

Open
FengDSP wants to merge 2 commits into
NVIDIA:mainfrom
FengDSP:fix_circular_cache
Open

Fix shape mismatch on the masked_tokens param in decoder masked multi-head attention kernel.#773
FengDSP wants to merge 2 commits into
NVIDIA:mainfrom
FengDSP:fix_circular_cache

masked_tokens uses session length everywhere

72319c6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs