Skip to content

feat: support some ops for lightllm and lmdeploy#115

Open
yao-fengchen wants to merge 1 commit into
llama2_infer_910bfrom
yfc/llama2_infer_910b
Open

feat: support some ops for lightllm and lmdeploy#115
yao-fengchen wants to merge 1 commit into
llama2_infer_910bfrom
yfc/llama2_infer_910b

add attenMask in paged_attention.

a8a02e0
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs