Also I note from your comments here you don’t plan on local inference - that seems like a huge self own, provided the model is less than like 2b params. I’m not saying people won’t in practice prefer your cloud version, but you have this huge uphill battle ahead of you on privacy which can be wiped at the stroke of a pen with “yep it will run on your Mac.”
You can get both markets (ease of use and technical) by allowing it. Also i would bet that you gain almost no product security locking off local inference - the hardware is the hard bit. Once someone has your hardware in hand it will not take them long to reverse and build their own processing layer; you’ll need to fight those people on patents and product quality.
Heck for a v1 just allowing local sensor data would probably be enough for the tech enthusiasts. But please don’t lock this off from the get go - it makes the sale harder and I don’t think it gives you much in return.
You can get both markets (ease of use and technical) by allowing it. Also i would bet that you gain almost no product security locking off local inference - the hardware is the hard bit. Once someone has your hardware in hand it will not take them long to reverse and build their own processing layer; you’ll need to fight those people on patents and product quality.
Heck for a v1 just allowing local sensor data would probably be enough for the tech enthusiasts. But please don’t lock this off from the get go - it makes the sale harder and I don’t think it gives you much in return.