Unfortunately, I have only seen 3 models, 3B or over, handle RAG.
Tested RWKV with a simple in-the-sports-news question and it didn't even get close to approaching the question. And nearly everything was fundamentally incoherent even in its internal reality (ex. Player gets 5000/game and is the first with 1000 in 16 games)
Unfortunately, I have only seen 3 models, 3B or over, handle RAG.
Tested RWKV with a simple in-the-sports-news question and it didn't even get close to approaching the question. And nearly everything was fundamentally incoherent even in its internal reality (ex. Player gets 5000/game and is the first with 1000 in 16 games)
(prompt: https://pastebin.com/sCLn5sCJ, response: https://pastebin.com/TqudvDbN)
I don't think there's a position for LLMs that are "just" writers on the market in 2025.