Comment

Comment by lioeters

It's in one of the collapsed comments. Quoted below:

https://github.com/ggerganov/llama.cpp/pull/11016#issuecomme...

So Ollama are basically forking a little bit of everything to try and achieve vendor lock-in. Some examples:

    The Ollama transport protocol, it just a slightly forked version of the OCI protocol (they are ex-Docker guys). Just forked enough so one can't use dockerhub, quay.io, helm, etc. (so people will have to buy Ollama Enterprise servers or whatever).

    They have forked llama.cpp (I would much rather we upstreamed to llama.cpp than forked, like upstreamining to Linus's kernel tree).

    They don't use jinja like everyone else, they use this:
https://ollama.com/library/granite-code/blobs/977871d28ce4

etc.

So we started a project called RamaLama to unfork all these bits

parent lioeters 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton