Add scalar LoRA value-head (critic) support for SAO-style RL - #85

Open

qywu wants to merge 8 commits into

mainfrom

qywu/value-head-critic

Commits on Aug 22, 2026

Add scalar LoRA value-head (critic) support for SAO-style RL
qywu
committed
5a700b8

Commits on Aug 24, 2026

GPU-validate the value head; add state_values, per-session frozen modules, docs
qywu
committed
7f99894
Update LoRAConfigRequest schema-shape test for frozen_module_patterns
qywu
committed
bdca804
Use the exact wire metric keys (is_*:mean) in the EV docs and SAO example
qywu
committed
79be32f
Document the per-session frozen-attention critic option
qywu
committed
15bae3a
All-reduce the value-head weight gradient over its shard mesh, not WORLD
qywu
committed
b5b6e84

Commits on Aug 27, 2026

Raise register_session response timeout to 600s
qywu
committed
ebb4eb1
Raise worker ack_timeout to 1800s
qywu
committed
f9f3f2d