Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,9 +39,10 @@ side by side through a single interface.
End-to-end retrieval-augmented generation pipeline that answers questions grounded
in a document set, with citations back to the source chunks.

**Stack:** `TF-IDF retrieval` `FastAPI` `Claude`
**Stack:** `Hybrid retrieval (RRF)` `Qdrant` `fastembed` `TF-IDF` `FastAPI` `Claude`

- TF-IDF retrieval chosen deliberately over embeddings — runs fully offline, deterministic, no API key required just to test retrieval quality
- Retrieval is chosen by configuration — TF-IDF, semantic (embeddings in Qdrant), or hybrid, which merges both rankings with Reciprocal Rank Fusion; TF-IDF stays a first-class mode that runs fully offline with no model download
- Each mode is measured on a 40-question golden set (hit rate@3: hybrid 0.975, semantic 0.900, TF-IDF 0.875), and CI fails if hybrid falls below the TF-IDF baseline — the README also says where semantic search alone loses
- Every generated answer returns alongside the exact chunks it was grounded in, not just a confident-sounding response

---
Expand Down
2 changes: 1 addition & 1 deletion ROADMAP.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@
| Project | Status | Stack | What it demonstrates |
|---|---|---|---|
| [Multi-Provider MCP Server](https://github.com/LacerdaTraderCode/mcp-multi-llm-server) | ✅ | MCP (official SDK) · Claude/GPT/Gemini adapters · httpx2 | MCP in practice + provider-agnostic architecture |
| [RAG Knowledge Assistant](https://github.com/LacerdaTraderCode/rag-knowledge-assistant) | ✅ | TF-IDF retrieval · FastAPI · Claude | End-to-end RAG with cited, grounded answers |
| [RAG Knowledge Assistant](https://github.com/LacerdaTraderCode/rag-knowledge-assistant) | ✅ | Hybrid retrieval (TF-IDF + embeddings, RRF) · Qdrant · fastembed · FastAPI · Claude | End-to-end RAG with cited, grounded answers, and retrieval measured per mode on a golden set with a CI quality gate |
| [AI Data & Evaluation](https://github.com/LacerdaTraderCode/ai-data-evaluation) | ✅ | Anchored rubrics · LLM-as-judge · preference data | Rubric design, golden-set agreement checking, DPO-shaped preference data |
| [Price Prediction with ML](https://github.com/LacerdaTraderCode/price-prediction-ml) | ✅ | scikit-learn (RandomForest + MLP) | Honest ML methodology: lookahead-free features, chronological split, baseline comparison |

Expand Down