Comment by martzoukos

I guess that there is no streaming option for sending generated tokens to, say, an LLM service to process the text in real-time.