Comment by ed

Retrieval models are trained on query/document pairs. At inference you tell it which side the text is on via a prefix it learned during training.

Which accomplishes the same thing as HyDE, but in the model instead of in text space. If the encoder has a query mode you skip the rewrite.

Voyage has an example of this in `input_type` https://docs.voyageai.com/reference/embeddings-api