mi355x

TokenSpeed is a speed-of-light LLM inference engine.

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

A from-scratch Rust inference stack for AMD GPUs that talks straight to the Linux kernel driver. No ROCm, HIP, or HSA runtime. Serves OLMo 2 on MI355X.

ATOM + NVIDIA Dynamo integration and upstream NIXL/MORI transport findings for AMD MI355X

Kimi-Linear long-context FP8 benchmark tooling for vLLM on AMD MI355X (AITER MLA head-padding + patched decode/prefill kernels).

Run LLM inference directly on AMD GPUs by bypassing ROCm for low-latency serving.