Pinned Loading

1. ggml-hexagon/ggml-hexagon ggml-hexagon/ggml-hexagon Public

   Forked from ggml-org/llama.cpp

   the original FastRPC-based implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU, history of ggml-hexagon: https://github.com/ggml-hexagon/ggml-hexagon/discussions/18

   C++ 53 8

2. ospoar ospoar Public

   open-source-project-observations-and-reflections（开源项目观察与思考）

3. ggml-hexagon/kantv ggml-hexagon/kantv Public

   workbench for learning and practicing on-device AI technologies under real-world scenarios on Android smartphones with online TV. powered by llama.cpp + whisper.cpp + FFmpeg + opencv-mobile

   Java 199 27

4. openvino openvino Public

   Forked from openvinotoolkit/openvino

   OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

   C++

5. MNN MNN Public

   Forked from alibaba/MNN

   MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

   C++

6. awesome-mobile-llm awesome-mobile-llm Public

   Forked from stevelaskaridis/awesome-mobile-llm

   Awesome Mobile LLMs