Comment

Comment by wowitsbase

agreed, if not for this project I've been making I would at least be using base llama.cpp

Personally I think it comes down to simplicity, but there's no reason for it's performance drops compared to llama.cpp while it's a wrapper of it.

parent wowitsbase 1 month ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton