Skip to content

1bit serve: a second warm-up request builds the small-batch weight layout at load (27B chat-short TTFT 2.64 -> 0.80 s) - #498

Merged
bong-water-water-bong merged 2 commits into
mainfrom
1bit/prefill-shape-warm
Oct 22, 2026
Merged

bong-water-water-bong merged 2 commits into
mainfrom
1bit/prefill-shape-warm

Commits

  1. Commits on Oct 22, 2026