Failed to load model after build

[rogerdcarvalho]

I'm working on an electron app using node-llama-cpp. While debugging it works great. However, when I run 'npm run build', the resulting app package suddenly throws the error "Failed to load model". What could be the reason of this? I don't think that during build the model is not properly placed, because if it can't find the model file it normally throws "ENOENT: no such file or directory".

[giladgd]

It's possible the you haven't included the binding binaries in the final build due to a missing configuration.
I recommend you to read the Electron guide and try to scaffold an Electron project to inspect its configuration and see what's missing in your project.

You can do that using this command:

npm create node-llama-cpp@latest -- --template electron-typescript-react

[rogerdcarvalho]

Which binding binaries do you reckon could be the culprit? I played with the template project and compared its build output with mine, and on first impression both seemed to contain the same content within node-llama-cpp and @node-llama-cpp in the asarUnpack directory as well as bundled within the .asar file.

[giladgd]

The binding binaries used depend on the OS type, architecture, and compute layer used (depends on what's available on the system).
If you inspect the @node-llama-cpp directory, you should see a directory that matches the above for your system, (for example, linux-x64-vulkan); explore the relevant directory and ensure that inside its bins/<module name again> directory there's a llama-addon.node and its native dependency libraries are there as well.
You can explore the "Code" tab of the @node-llama-cpp/linux-x64-vulkan module on npm to see what to expect.

Also, try starting the Electron app (after you build and pack it) from the terminal, so you can see the error logs when things fail.
You can also enable debug mode via getLlama({debug: true}) and see many more logs from llama.cpp in the Electron build when you run it from the terminal.

If you're still having trouble with this, consider sharing a reproduction repo with me so I can give it a look.