Comment by fpierfed

What kind of latency does this generate? I guess for LLM operations the extra latency might not bet that important. Is that correct?