Comment by kamranjon

llama.cpp sycl and vllm xmx work is pretty incredible right now - you just gotta build it with some extra flags