Skip to content

forward-serve: the tokenizer's eos_token and the ChatML turn end are stop ids too — <|im_end|> was served as text on FLM's Qwen3.5-2B (Refs #1785, #1786) - #2064

Merged
bong-water-water-bong merged 3 commits into
mainfrom
cl-flm/stop-on-turn-end
Nov 11, 2026
Merged

bong-water-water-bong merged 3 commits into
mainfrom
cl-flm/stop-on-turn-end

Commits

  1. Commits on Nov 10, 2026

  2. Commits on Nov 11, 2026