Comment

Comment by bArray

So this work appears to work on inference speed and getting large models to work on simpler RAM constrained hardware, whereas my (private) work has been on getting simpler RAM constrained hardware to give agentic behaviour with small models. I've already started the work of using some of the learnings described in this repository. Looking forward to seeing what can be achieved.
parent bArray 9 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton