Comment Comment by sh79 It was mentioned in another comment to the parent. There are no alternatives currently, the whole thing has been built upon llama.cpp since its inception. parent sh79 2 years ago