Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions npu/forward/include/q4nx_forward.h
Original file line number Diff line number Diff line change
Expand Up @@ -234,6 +234,11 @@ class Q4nxNpuForward {
// Set only while step_batch_all() runs: the batched epilogue then norms every row and writes M x NV
// logits there instead of only the last row's. Null on every other path, so nothing else changes.
std::vector<float>* batch_all_out_ = nullptr;
// engine#803 A2b step one: the decode-family block as its own method, body unchanged, so the move into
// XdnaTarget::open_decode_family() is a copy rather than surgery inside init_impl.
bool open_decode_family_local(bool want_m16, xrt::device* dev, const std::string& mdir,
const std::string& dir);

bool init_impl(xrt::device* dev, const char* model_path,
const std::string& artifact_dir);
bool host_gemm_ = false;
Expand Down
Loading
Loading