Comment Comment by CharlieDigital Are people using 32k embeddings and no longer chunking?It feels like embedding content that large -- especially in dense texts -- will lead to loss of fidelity/signal in the output vector. parent CharlieDigital 1 year ago
It feels like embedding content that large -- especially in dense texts -- will lead to loss of fidelity/signal in the output vector.