LLM speculative inference server for heterogeneous hardware & consumer GPUs
-
Updated
Aug 27, 2026 - C++
LLM speculative inference server for heterogeneous hardware & consumer GPUs
Add a description, image, and links to the r9700 topic page so that developers can more easily learn about it.
To associate your repository with the r9700 topic, visit your repo's landing page and select "manage topics."