Comment by alightsoul

I failed a few days ago to use the npu with openvino and llama.cpp. I will try again with this and hopefully open source it. Thanks

Of course I will do everything on Linux. Might contribute back