Comment by smarvin2

It does work by running the LLM on the database server but you can configure the LLM to run on the GPU