Skip to content

npu tokenizer: read a vocabulary whose normalizer rewrites spaces to the word-boundary symbol and prepends none (fixes #2215) - #2217

Merged
bong-water-water-bong merged 3 commits into
mainfrom
cl-npuperf/tokenizer-replace-meta
Nov 11, 2026
Merged

bong-water-water-bong merged 3 commits into
mainfrom
cl-npuperf/tokenizer-replace-meta

Merge remote-tracking branch 'origin/main' into cl-npuperf/tokenizer-…

20e2c7a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (python)
succeeded Nov 11, 2026 in 1m 19s