Comment Comment by wedn3sday One obvious use case is that it makes per-token generation much cheaper. parent wedn3sday 2 years ago