Comment by lathiat

Why not leverage Apple Foundational models?

Downloads will already be on the machine.

https://developer.apple.com/documentation/foundationmodels