Comment by dstu

I’m surprised this hasn’t had more attention, it seems like it should be a really solid half way house between the Jev-alikes and full-fat LLM calls. Hopefully ‘soon’ means ‘days’ for the open weights release.