Comment by benpacker

Does this have support for generators / streams, or any ideas how you'd do it? With LLMs that an increasingly large part of client/server communication.