Skip to content

Commit ea228aa

Browse files
committed
Add checked JiuwenSwarm feature knowledge and separate depth audit
1 parent 9309554 commit ea228aa

99 files changed

Lines changed: 14844 additions & 0 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎eval/knowledge-depth/README.md‎

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
# JiuwenSwarm implementation-knowledge depth
2+
3+
The pinned run at `f0a69728c96b5961d993449f1a901cbd2f4dac5b` added **173 checked facets across 77 feature-depth pages**. Every accepted block is bound to an actual Codex review, its exact prose, and pinned source spans. The independent audit reports no proof errors.
4+
5+
| Measure | Before | After |
6+
| --- | ---: | ---: |
7+
| Feature breadth | 79/79 | 79/79 |
8+
| Production-file breadth | 2043/2199 (92.91%) | 2043/2199 (92.91%) |
9+
| Features with checked depth blocks | 0/79 | 77/79 |
10+
| Checked depth facets | 0/553 | 173/553 (31.28%) |
11+
| Features with all seven depth facets | 0/79 | 0/79 |
12+
| Production files participating in depth evidence | 0 | 115 |
13+
14+
Breadth includes checked interface records and feature summaries. The 115 participating files are witnesses for particular claims, not files with exhaustive behavior coverage. Existing owner explanations also remain useful; this conservative depth metric counts only the new bound blocks.
15+
16+
All 79 features received extraction attempts. **Cron and skill evolution have no approved depth facets** after retries; their existing summaries remain. Other missing facets are listed per feature in the [full report](jiuwenswarm-f0a69728c96b.json). A full seven-facet feature is still an open target.
17+
18+
Generation used Zcode GLM-5.3 at low effort; review requested Codex gpt-6-sol at low effort. The completed traces contain 121 generation calls and 112 review calls, including failures. The generator reports served identity when it returns a result; Codex does not report served-model identity. Two interrupted generation attempts have unreported usage and are recorded separately.
19+
20+
Inputs included existing knowledge, 299 distinct source files, and 86 project documents. Of those documents, 24 came from the partial `.doc_project_maintainer` collection, used for 66 features. Historical test ledgers were context rather than evidence of current test passes. Validation facets describe assertions at the source pin; upstream JiuwenSwarm tests were not executed here.
21+
22+
The final batch used $56 of fixed review accounting, plus $4 of earlier diagnostic accounting, within the original $60 ledger ceiling. Native subscription clients report no invoiced USD cost. These amounts are budget reservations, not measured billing or a cap on an actual invoice.
23+
24+
The report contains the frozen knowledge baseline and input digest, code revisions used by the native calls, input paths, before/after audits, knowledge and policy hashes, and per-block native approval bindings. Raw prompts and verdict replies remain in ignored local state.
25+
26+
Recompute the audit against a clean checkout at the exact pin:
27+
28+
```bash
29+
PYTHONPATH=src python tools/audit_knowledge_depth.py \
30+
--repo jiuwenswarm \
31+
--upstream /path/to/pinned/jiuwenswarm \
32+
--pin f0a69728c96b5961d993449f1a901cbd2f4dac5b \
33+
--report /path/to/local/depth-audit.json
34+
```
35+
36+
`kb widen jiuwenswarm` expands explanatory knowledge. `kb deepen jiuwenswarm` adds implementation facets; `--retry-unfinished` retries gaps with cumulative accounting and priority for features without accepted depth. Use a fresh state directory after publishing and merging a batch. Existing rule-focused `kb init --stage deepen` keeps its original behavior.

0 commit comments

Comments
 (0)