Comment by elliotto

In my experience the api call is trivial compared to the time taken for the LLM to compose the response.