Comment by ewalk153

When coupled with smaller parameters sizes, it enables BYOD, different cost scaling, and local inference.