Simple LLM package for ios devices.

Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro

codebase for "MELTing Point: Mobile Evaluation of Language Transformers"

Dockerfiles for poetry/mlc-llm(rk3588)/...

An example of integrating local LLMS using mlc-llm into an iOS app

A React Native application that enables on-device Large Language Model (LLM) chat functionality with intelligent context management. Built with TypeScript and modern React Native practices.

Privacy-first on-device LLM inference for Android. Real-time AI conversations without data leaving your phone. Powered by MLC-LLM.

Pre-built TVM Windows x64 binaries with LLVM support - enables MLC-LLM model conversion on Windows

Inference runtime benchmarks, configs, and production setup for a Jetson Orin Nano Super 8GB — llama.cpp, ONNX Runtime, MLC-LLM, Gemma 4, multimodal

Android agent runtime and workflow compiler for local LLM-powered screen/API automation

an hardware benchmark using wedsite

A real-time 3D street view chatting with built-in AI powered by WebGPU.

Reproducible research lab for browser-local small-model RAG with WebGPU/WebLLM runtimes, evidence-packet compression, latency benchmarks, and rights-aware archive fixtures.

Apple Silicon LLM benchmark suite measuring Token/s, RAM, power draw and ANE usage. Supports Ollama, llama.cpp, MLC and GGUF.