Skip to content

forward-serve: the tokenizer's eos_token and the ChatML turn end are stop ids too — <|im_end|> was served as text on FLM's Qwen3.5-2B (Refs #1785, #1786) - #2064

Merged
bong-water-water-bong merged 3 commits into
mainfrom
cl-flm/stop-on-turn-end
Nov 11, 2026
Merged

bong-water-water-bong merged 3 commits into
mainfrom
cl-flm/stop-on-turn-end

Merge branch 'main' into cl-flm/stop-on-turn-end

59cb8c3
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (actions)
succeeded Nov 11, 2026 in 41s