Skip to content

Commit 99df38d

Browse files
author
Ronald Tse
committed
fix(ride): batch-slice the hidden-state tensor, not the layer tuple
1 parent 20a0428 commit 99df38d

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎src/gpu/modal_distill.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1321,7 +1321,7 @@ def _usable(ck: Path) -> bool:
13211321
t_hs[L].float(), b_hs[L].float(), ride["lam"]
13221322
) @ ride["W"][L].T
13231323
m = masked_mse(
1324-
s_out.encoder_hidden_states[:sub][L].float(), tgt, am[:sub]
1324+
s_out.encoder_hidden_states[L][:sub].float(), tgt, am[:sub]
13251325
)
13261326
mse_total = m if mse_total is None else mse_total + m
13271327
if ride["beta"] is None:

0 commit comments

Comments
 (0)