Comment by recentlypostedj

What are the usecase that you can think of because 3.77 tok/s is actually to slow and better call a cloud API to do the task