Comment

Comment by elashri

It seem that someone already published different quanta versions of the model [1] . This can be used to define Modelfile to use with ollama locally. But I am not sure that zed allows changing the endpoint of this feature yet (ever). Of course it is opeb source and you can change it but then you will need to build it.

[1] https://huggingface.co/mradermacher/zeta-GGUF

parent elashri 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton