Comment Comment by rohansood15 Given the new architecture, speeds are harder to estimate. Max would be ~40 tok/s. parent rohansood15 2 months ago
