Comment

Comment by leftytak

I picked up the same model, including the shipping to Canada, it ended up costing a lot for what it is.

How are you hosting your LLM locally? I tried Ollama on an M4 Mac mini, even with a smaller LLM, the performance was very poor.

parent leftytak 7 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton