llama: batched readahead for lazily read gather tables - #137

llama: batched readahead for lazily read gather tables#137

danielhanchen wants to merge 1 commit into

base/upstream-ca3d5a3e1unslothai/llama.cpp:base/upstream-ca3d5a3e1from

prefetch/lazy-tensor-row-readaheadunslothai/llama.cpp:prefetch/lazy-tensor-row-readaheadCopy head branch name to clipboard