Comment by Macuyiko

Things such as AirLLM, or good old llama.cpp.