Comment by pmarreck

Time to put this 128GB M4 Mac to work...

    bash> ollama run hf.co/unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF:Q5_K_M

(49GB!)

(It wouldn't accept the Q_8 because it was sharded.)

Will report back lol

What app do you use on your phone to access your home LLM servers over tailscale?