Comment by IblankI

I completely agree. Plus, pushing inference on-device makes it vastly safer. Keeping everything local solves the biggest privacy and security concerns of routing sensitive data through the cloud right now.