kartik-sddb
Joined 3 years ago
Karma
1
Submissions
7
Member since
Oct 27
Senior AI Engineer
View on Hacker NewsJoined 3 years ago
Sure you can have a mesh of database, Have your input data in one data technology, run models on a distributed compute, save models on different database tech and manage the jobs on other!
Absolutely you can query the embeddings of 1.6M rows, you can try with lance or in memory vector search type. The scalablity will depends on embedding size, machine configurations, etc. Thanks
Lots of cool feature are in pipeline,
Please join a free official webinar from MongoDB, we are hosting about how SuperDuperDB could enable and manage vector search with atlas
https://www.eventbrite.com/e/enable-and-manage-vector-search...
Thanks