Comment by gaya3bollineni

Running a 125M model on-device at that speed is impressive. How much did you have to optimize the model to get that performance on an iPhone?