Skip to content
#

inference-router

Here are 10 public repositories matching this topic...

Route LLMs, embeddings, image generation and speech-to-text across the Macs, Linux servers and Windows PCs you already own. One OpenAI-, Ollama- and Anthropic-compatible endpoint, so Claude Code and Codex run on your own machines. Zero config.

  • Updated Nov 20, 2026
  • Python

CLI-first OpenAI-compatible LLM router/proxy for coding agents that picks the cheapest fast-enough model and proves speed, savings, and prompt-free privacy.

  • Updated Jun 2, 2026
  • JavaScript

The Apex MCP Gateway & Inference Router Kernel: Solving NP-Hard Bottlenecks via Alien's Trick, Radix KV-Cache, Conformal Cascading, Link-Cut Trees, SWAR Bitsets, and KKT Water-Filling.

  • Updated Oct 1, 2026
  • Python

Add this topic to your repo

To associate your repository with the inference-router topic, visit your repo's landing page and select "manage topics."

Learn more