Comment Comment by fastball Tokenization is <0.1% of the inference time for the first token in the same way it is <0.1% for the last. parent fastball 3 months ago
