iree-android: stateful KV session (IreeKvSession / IreeKvDecoder, libskainet_iree_kv.so) — prefill once, snapshot, chunk per utterance, step per token (#410) - #418

Merged

michalharakal merged 2 commits into

iree-android-kv-session

Sep 4, 2026

Commits on Sep 4, 2026

iree-android: stateful KV session (IreeKvSession / IreeKvDecoder, libskainet_iree_kv.so) — prefill once, snapshot, chunk per utterance, step per token (#410)
michalharakal
committed
789416c
iree-android: arm64-v8a build of libskainet_iree_kv.so; README for the KV session with the measured numbers
michalharakal
committed
409177b