I looked at this on Twitter and will try it out using the integration with Llamaindex !! The idea of Late Interaction sounds like an improvement either on top of or in place of a vector db approach. I was looking at the BERT family in general so while ColBERT is a great implementation it would be interesting to have this same "everything in the one gumbo pot" type library for working with robert(a)/tinybert/qbert/distilbert/.....
Great project and I hope the post gets on the HN second chance loop !
Great project and I hope the post gets on the HN second chance loop !