cognisoc

Here are 6 public repositories matching this topic...

Learn how LLMs work by building one in Zig -- from tensors to text generation.

machine-learning zig tokenizer inference text-generation transformer educational tensors from-scratch learn-by-doing llm cognisoc

Run local GGUF language models from .NET — one package, one format, one programming model.

machine-learning csharp dotnet nuget inference llm llama-cpp local-llm gguf cognisoc single-package

Run AI models directly on mobile devices. No cloud. No latency. Complete privacy.

dart library privacy mobile inference artificial-intelligence flutter edge-ai no-cloud llm llama-cpp local-llm gguf mobile-llm on-device-llm cognisoc

Run any LLM locally. Use it from any language. Deploy anywhere.

nodejs python c go rust cli php machine-learning inference bindings large-language-models llm llama-cpp local-llm gguf openai-compatible-api llm-runtime cognisoc

A modular LLM inference runtime written in Rust.

rust modular inference crates-io rustlang modular-design llm rust-runtime ai-infrastructure llm-runtime cognisoc

A bare-metal C unikernel for serving large language models -- no OS, no overhead.

c embedded inference operating-system unikernel low-overhead bare-metal no-os llm llm-serving llama-cpp local-llm gguf cognisoc

To associate your repository with the cognisoc topic, visit your repo's landing page and select "manage topics."