Comment Comment by pzo Wouldn’t that invalidate kv cache and you wouldn’t benefit from much cheaper cache read? parent pzo 2 months ago
