Analytical benchmark connecting pipeline parallelism and KV cache management: bubble-time overlap for disaggregation, prefix reuse tax of PP stages, and tiering speedup across NVLink, InfiniBand, and PCIe
performance-engineering benchmark simulation inference systems infiniband disaggregation pcie nvlink analytical-model tiering pipeline-parallelism kv-cache llm llm-serving machine-learning-infrastructure prefix-sharing kv-cache-management bubble-time
-
Updated
Jul 26, 2026 - Python