Comment by priyanmuthu

If the concern is about the inference cost -- we do have open-weight models that are getting more powerful, and hardware to run small-ish models cheap. I run agents using small local models in my MacBook.