Comment by robbomacrae

Most of the open weight models are can be used on device: https://orcabot.com/benchmarks/open-weight-tts