hskalin
Joined 3 years ago
Karma
45
Submissions
47
Member since
Jan 29
Joined 3 years ago
It makes sense that humans would have been using it though, chatgpt learned from us afterall
I think doing it locally with an open source model would be a lot cheaper as well. Especially because they wouldn't have to keep using OpenAI's API for each new query.
Edit: I overlooked the about page (https://searchthearxiv.com/about), seems like they *are* using OpenAI's API, but they only have 300K papers indexed, use an older embedding model, and only calculate embeddings on the abstract. So this should be pretty cheap.