Comment by zc2610

we encountered that issue and fixed it + a separate sse event type to signal start/end of summarization for ui/ux.

we also build a lot on top of it like more accurate token estimation, customized offloading mechanism etc.