Comment

Comment by lxe

Why isn't this type of expert caching in the native llama.cpp yet? Why do we need a separate codebase?
parent lxe 28 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton