Comment by harsh_neeraj

Hello, Given that the majority of businesses have private subnets, I believe the primary question for which everyone is searching for a solution is how to access any LLM in a private subnet. Your suggestion can be put into action if this problem can be fixed.