harsh_neeraj

Just checked out the repo — looks good. Only thing I'd suggest is maybe plug in LiteLLM for a more generalized inference setup. Could make things more flexible

Yes, I was talking specifically about the log analysis part. Yes it is a good idea and will be a useful service. Especially where we need to configure servers on cloud, it can be implemented that it can decide the packages required as well as the hardware specifications according to the use case provided. As these things are really hard to decide at the start if a person is not having any experience in configuring the hardware specs.

Hello, Given that the majority of businesses have private subnets, I believe the primary question for which everyone is searching for a solution is how to access any LLM in a private subnet. Your suggestion can be put into action if this problem can be fixed.