Comment by osanseviero

Hi! What implementation are you using? Right now VLLM is the one recommended. llama.cpp is in an early draft