nisegami
Joined 5 years ago
Joined 5 years ago
No.
>Do you make a frontier model orchestrate it?
Also no.
>Are you running with llama.cpp?
Yes, on Arch Linux.
>Sorry for the barrage of questions
No worries.
My Qwen testing has been with Hermes trying to do mundane (to me) things that hosted models understandably refuse to do, even open-weight ones like Deepseek V4.1 Flash. Example: I tried to get it to find a torrent for $tvshow and add it to qbittorrent (connected to hermes via MCP already). It certainly tried and I think frontier models would have done better. My biggest issue was context space more than anything else. I had to drop down a quant level to increase it to 128k. On 64k it was constantly compacting.
This exists btw, from Ring: https://ring.com/ca/en/search-party
From everything I've seen, they're all too large and dysfunctional to make a competent play in consumer AI. Anyone in there trying to work on it is too far removed from end product and is answering to too many masters.
If we can enable a feedback loop, yes absolutely. But feedback loops for things in the physical world like these are measured in months per cycle usually.
I agree wholeheartedly and in keeping with that, I call upon frontier AI labs to release both their weights and training sets.
We can lower our standards instead