Comment by rangerelf

llama-server from the llama.cpp package has a local web interface.