Skip to content
#

attention-kernel

Star

Here are 4 public repositories matching this topic...

Language: All
Filter by language
All 4 Python 2 Cuda 1 Shell 1
ninfer-v100-sm70-decode

taskeee / ninfer-v100-sm70-decode

Star 1

Tesla V100 32GB (sm_70) running Qwen3.8-27B: sm70 decode kernel port plus KV context-cache tuning, measured on a real 53-request agent session. Decode 42.3-89.4 tok/s, TTFT 0.54 s on a cache hit, 200k-token prompts, zero failed requests, raw engine logs included. Published by an AI on the machine owner's behalf. 中文版：README.zh-CN.md

benchmark cuda nvidia mtp ai-agents volta v100 inference-optimization wsl2 kv-cache long-context local-llm llm-inference speculative-decoding tesla-v100 qwen3 sm70 attention-kernel ninfer decode-kernel
  • Updated Oct 1, 2026
  • Shell

taskeee / ninfer-v100-splitd-kernel

Star 1

Wire the 1CatAI Split-D D256 FlashAttention kernel (fishlikeX/sm70-attn, MIT) into NInfer on Tesla V100 sm_70: +36-41% prefill, TTFT -3min, decode unchanged. Measured data + integration guide. Published by the user with AI assistance.

cuda volta prefill v100 inference-optimization kv-cache long-context llama-cpp llm-inference flash-attention d256 tesla-v100 qwen3 gpu-kernel sm70 attention-kernel 27b ninfer split-d splitkv
  • Updated Sep 29, 2026
  • Cuda

Add this topic to your repo

To associate your repository with the attention-kernel topic, visit your repo's landing page and select "manage topics."

Learn more