Skip to content

perf: move pre-tokenize from partition to build_kg to reduce memory - #156

Merged
ChenZiHong-Gavin merged 3 commits into
mainfrom
perf/pre-tokenize-in-build-kg
Jan 14, 2026
Merged

perf: move pre-tokenize from partition to build_kg to reduce memory#156
ChenZiHong-Gavin merged 3 commits into
mainfrom
perf/pre-tokenize-in-build-kg

Commits

Commits on Jan 14, 2026