Skip to content

resilience: harden Knowledge Base ingest queue - #11

Merged
sarthakagrawal927 merged 4 commits into
mainfrom
docs/knowledge-system-consolidation
Jul 18, 2026
Merged

resilience: harden Knowledge Base ingest queue#11
sarthakagrawal927 merged 4 commits into
mainfrom
docs/knowledge-system-consolidation

Conversation

@sarthakagrawal927

Copy link
Copy Markdown
Member

Adds parse timeouts, active lease overlap protection, structured failure classification/logging, poison-message handling, and duplicate-delivery coverage. Worker typecheck and 354 tests pass.

sarthakagrawal927 and others added 2 commits July 18, 2026 17:37
Unify scattered root-level and docs/ markdown into one canonical, agent- and
human-readable knowledge system. Markdown in docs/ is the source of truth;
Blume is only the presentation/search layer.

Created:
- STATUS.md: short live-status view (objective, state, blockers, unresolved
  questions, next steps, deferred, deploy fingerprint).
- docs/index.md: navigation hub.
- docs/maintenance.md: how to edit this docs system, validate, and build Blume.
- docs/product/overview.md: product thesis, wedge, surfaces, empirical headline.
- docs/architecture/decisions.md: durable architectural decisions (A1-A12) and
  the why behind each.
- docs/development/workflows.md + testing.md: per-package commands, pre-commit,
  CI, gate taxonomy.
- docs/operations/jobs.md: async ingestion (Queues + Workflows); no cron jobs.
- docs/knowledge/learnings.md + failed-approaches.md: distilled durable lessons
  and resolved traps.
- blume.config.ts: Blume presentation config (content root = docs/).
- package.json: docs-tooling only (blume + link checker); NOT a product workspace.
- scripts/docs-check-links.mjs: dependency-free internal link/frontmatter checker.
- .github/workflows/docs.yml: CI for link check + Blume build.

Moved (git mv, history preserved) into canonical homes:
- docs/agent-*, bring-your-own-corpus, demo-walkthrough, onboard-new-domain
  -> docs/product/
- docs/cloudflare-full-port.md -> docs/architecture/
- docs/runbook, hosting-personal, highsignal-integration -> docs/operations/
- docs/learning/new-things.md -> docs/knowledge/
- DESIGN.md -> docs/architecture/overview.md

Archived (git mv, snapshots preserved with banners pointing to successors):
- NOTES, LEARNING, GROK_FINDINGS, LIVE_VERIFICATION, SESSION_LOG, WRITEUP(.md/.pdf),
  PROJECT_STATUS, docs/cloudflare-agent-handoff -> docs/knowledge/archive/

Merged/updated:
- AGENTS.md: concise bootloader with doc navigation + maintenance rules.
- README.md: reading guide now points to canonical docs/ homes.
- .gitignore: Blume output (dist/, .blume/) + agent logs.

Validation: node scripts/docs-check-links.mjs -> 32 files, 0 errors, 0 warnings.
Worker code, existing CI (ci.yml, eval.yml), Makefile, and pre-commit config
untouched.

Unresolved (recorded in STATUS.md): app/public/llms.txt advertises /api/ai but
the served file is /api-ai.json (no Next.js /api/ai route).

Generated with [Devin](https://devin.ai)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jul 18, 2026

Copy link
Copy Markdown

Deploying knowledgebase-landing with  Cloudflare Pages  Cloudflare Pages

Latest commit: e027752
Status: ✅  Deploy successful!
Preview URL: https://cbacccde.knowledgebase-landing.pages.dev
Branch Preview URL: https://docs-knowledge-system-consol.knowledgebase-landing.pages.dev

View logs

@sarthakagrawal927
sarthakagrawal927 force-pushed the docs/knowledge-system-consolidation branch from 0bdd5ec to 59a159d Compare July 18, 2026 23:21
@sarthakagrawal927
sarthakagrawal927 merged commit 0d4792a into main Jul 18, 2026
5 checks passed
@sarthakagrawal927
sarthakagrawal927 deleted the docs/knowledge-system-consolidation branch July 18, 2026 23:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant