Comment by kwamenum86

Librechat seems perfect for your use case. It’s open source as well. Used by many of the big techcos to solve the problem you’re describing, so it’s battle tested https://www.librechat.ai