Popular repositories Loading

1. Strata Strata Public

   Forked from Niko1221/Strata

   Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

   C++ 3 1

2. web-bench web-bench Public

   Webベースベンチマークソフト。

   HTML

3. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

4. llmservebench llmservebench Public

   Benchmark and compare LLM inference backends (OpenAI-compatible APIs) - llama.cpp, Ollama, LM Studio, vLLM

   Python

5. i-AI-Studio i-AI-Studio Public

   Local web UI to install, manage, and chat with OpenVINO Model Server (OVMS).

   Python

6. openvino_tokenizers openvino_tokenizers Public

   Forked from openvinotoolkit/openvino_tokenizers

   OpenVINO Tokenizers extension

   C++