Hmm, does this just use the traditional term frequency search bars (scholar, arxiv, etc) under the hood with query expansion for the prelimary search?
Without chunking the papers I'm skeptical the prelim search would be all that useful.
Also, using GPT4 as a cross encoder seems really wasteful both in terms of compute and latency.
Using GPT4 as a cross encoder also seems very wasteful.
Might try it anyways, but damn 3-6mins is brutal. Traditionally research has shown that low latency is more important than relevance for search because it allows users to reformulate queries.
Without chunking the papers I'm skeptical the prelim search would be all that useful.
Also, using GPT4 as a cross encoder seems really wasteful both in terms of compute and latency.
Using GPT4 as a cross encoder also seems very wasteful.
Might try it anyways, but damn 3-6mins is brutal. Traditionally research has shown that low latency is more important than relevance for search because it allows users to reformulate queries.
Maybe this approach is worth it though.