Comment by tealcod

Would it be possible to run something like vLLM or TensortRT-llm with tinfoil?