AI annotation QA workflows for ranking, relevance scoring, factuality checks, and safety evaluation.
-
Updated
May 26, 2026 - Python
#
evaluation-pipeline
Here are 11 public repositories matching this topic...
Automated quality evaluation for RL agent discoveries using LLM as Judge, rule based validation, and closed loop reward feedback
-
Updated
Apr 9, 2026 - Python
Capability Schema Spec defines a shared semantic language for world model evaluation. Standardize capability definition, observation, and verification across models and benchmarks. Not a benchmark—a shared language. Define • Observe • Verify
python pytorch robotics-simulation model-based-rl video-prediction world-models dreamer4 evaluation-protocol score-normalization temporal-stability conformance-testing model-observability world-model hallucination-detection model-reliability evaluation-pipeline capability-schema world-model-evaluation evidence-based-evaluation generative-world-model
-
Updated
Jul 3, 2026 - Python
LLM-as-a-Judge evaluation pipeline — score and compare LLM outputs with a separate judge LLM
python nlp gemini openai model-evaluation pairwise-comparison llm llm-evaluation llm-as-a-judge evaluation-pipeline
-
Updated
Apr 6, 2026 - Python
🏥 Modular Agentic RAG Medical Assistant 🤖 built with LangGraph, Pinecone, Groq & Tavily. It intelligently routes queries between RAG, live web search, and direct answers. 🔬 Live tracing shows every agent step, while FastAPI + Streamlit deliver a production-ready full-stack experience. 🚀
query-planning ai-observability llm-evaluation adaptive-rag evaluation-pipeline medical-ai-guardrail
-
Updated
Jul 10, 2026 - Python
Production-grade Safe GenAI Agent Orchestrator with intent routing, hallucination guard, tool orchestration, evaluation pipeline, and multi-screen Next.js dashboard.
typescript nextjs ai-safety prisma ai-agent llm genai fullstack-ai agent-orchestrator evaluation-pipeline
-
Updated
Feb 21, 2026 - TypeScript
End-to-end AI evals orchestration platform for comparing LLM outputs across providers with transcription, structured logging, human review, and Supabase-backed decision tracking.
gemini openai multi-model transcription human-in-the-loop model-comparison supabase anthropic llm-evaluation ai-evals evaluation-pipeline
-
Updated
Mar 10, 2026 - TypeScript
AI Agent Validation Pipeline — agentic workflow tool that runs tasks through LLM, validates outputs via multi-rule harness, applies supervised handoff routing, and generates evaluation reports.
python machine-learning automation validation developer-tools groq ai-agent llm llama3 agentic-ai evaluation-pipeline supervised-handoff
-
Updated
May 18, 2026 - Python
Production-ready automated evaluation pipeline for LLM prompts, prompt regressions, RAG systems, and autonomous agent workflows.
-
Updated
Sep 4, 2026 - Python
Generates prompt evaluation pipeline for an eCommerce website Agent.
-
Updated
Jul 4, 2026 - Jupyter Notebook
🤖 An advanced, policy-compliant RAG-powered Internal Knowledge Assistant for TechNova. Built with LangChain, Chroma DB, and Llama 3.3 (Groq). Features strict source grounding, 100% retrieval precision, comprehensive factual citations, automated evaluation pipelines, and a dynamic multi-category Gradio chat interface. 🚀
information-retrieval rag vector-database ai-engineering llm langchain groq-api llama3 evaluation-pipeline
-
Updated
Jun 14, 2026 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the evaluation-pipeline topic, visit your repo's landing page and select "manage topics."