Comment by pratik_kanthi

Yes they can. But the ergonomics of that aren't great. Also ollama takes up a sigificant amount of memory. I'm trying this with a cheap model like phi-3 hosted on my server.