Comment Comment by tgluck Not reallythey distill different things. model2vec distills a sentence transformer into static embeddings, so the output is a faster general-purpose encoder.Jevstiller keeps the encoder frozen (bge-small by default) and distills Jev's decisions on one specific question into a small head on top of it parent tgluck 1 month ago
they distill different things. model2vec distills a sentence transformer into static embeddings, so the output is a faster general-purpose encoder.
Jevstiller keeps the encoder frozen (bge-small by default) and distills Jev's decisions on one specific question into a small head on top of it