Comment by calipsow

Thanks for the resources I’ll check them out, my purpose behind this is actually I want to build an app, which requires to call a LLM to serve the features I want to add, so I thought either build my own http api wrapper around an LLM, or just use the OpenAI api.. it depends on what’s cheapest in the end. And I’m not planning to train any models, just running existing open source models through a cloud provider.