llmop

Here are 4 public repositories matching this topic...

Addy-shetty / Pitt

PITT is an open‑source, OWASP‑aligned LLM security scanner that detects prompt injection, data leakage, plugin abuse, and other AI‑specific vulnerabilities. Supports 90+ attack techniques, multiple LLM providers, YAML‑based rules, and generates detailed HTML/JSON reports for developers and security teams.

prompt prompt-toolkit security-tools llm prompt-engineering prompt-injection prompt-injection-tool llmop

Updated Jul 30, 2025
Python

Shamratha / LLM-GATEWAY

Star

OpenAI-compatible LLM API gateway: per-team rate limits & budgets, automatic multi-provider fallback, circuit breakers, and Grafana observability. FastAPI + Redis + Prometheus.

python docker redis api-gateway grafana fallback rate-limiting prometheus reverse-proxy openai circuit-breaker observability fastapi llm anthropic llmop

Updated Jul 4, 2026
Python

Sruthi0510-data / rag-failure-attribution

Star

Attributes RAG retrieval failures to what actually caused them: the ones a better retriever can fix against the ones only re-chunking can. Finds the questions your recall metric scores as wins while the answer is not recoverable at all. recall@5 reports 89.7%; 37.5% of questions are answerable; 195 scored hits cannot be answered.

python nlp information-retrieval evaluation embeddings chunking semantic-search data-quality rag vector-search llmops retrieval-augmented-generation llmop

Updated Oct 1, 2026
Python

katiiab01 / Cost-Tree

Star

AI agent cost, node by node, from your OpenTelemetry traces. Thrown-away attempts included.

Updated Sep 8, 2026
Python

Add this topic to your repo

To associate your repository with the llmop topic, visit your repo's landing page and select "manage topics."

Learn more