Pranav_Ghoghari
Joined 2 years ago
Karma
1
Submissions
6
Member since
Feb 20
Joined 2 years ago
With LLMs, even with JSON schema constraints and structured output, the actual cost can still be hard to predict because of varying output lengths and, especially, unpredictable reasoning costs. There is something really nice about being able to tokenize and predicting the budget beforehand.
Thinking about making an open-source library specific to Vector related operations like clustering, classification, anomaly detection to make it easy for developers to get more out of their vector embeddings. Basically sk-learn for Vector operations.