trissi1996
Joined 9 years ago
Joined 9 years ago
Vibes are not a meaningful comparison.
You can't compare different quantizations(Q4_K_M & Q4_K_XL) and also use a temp of 0.7 and use that for any meaningful comparison.
All difference you notice could be either due to temp randomness or quantization differences even if the original weights are exactly the same.
Also these were likely sourced differently so the quantizers could've used different quantization importance matrizes or process.
The weights are the same, the weights are all that matters.
Never heard about that.
llama-server --model-url "https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-32B-IQ4_XS.gguf"
Will get you up and running in one single command.Still a bit of an annoyance, but one I don't notice once it's set up.
Port forwarding works and you can get a raw wireguard config to dockerize it.
For general use in e.g. open hotspots I still use mullvad/mozilla vpn as I trust them more. (And can pay cashfor mullvad)
Others might be good, but no idea who exactly, many small unknown companies in the list that could be either great or shitty.
Auth-codes given on the website were expired and they took 2 weeks to give me the correct ones near the end of the registry period.
Support was extremely unresponsive. As this this was a side project I couldn't spent time on every day my domain went into quarantine for a short time. They answered 2 days before the end of the rental period, when requesting the auth codes ~2.5 weeks before.
Will never use them again after this experience.
Porkbun is my new home for most stuff and domains.lt for .lt which porkbun doesn't offer yet sadly.
On any x86 UEFI system I tried i never had any issues at all, but Pi's I remember as a huge PITA...
Or is this just a general ARM issue ?
Also to be productive you have to utilize the rest of the erlang ecosystem, so at least some superficial knowledge in elixir & erlang is helpful for for some use-cases.
Syntactically I actually don't think it's that for off, but I dunno what GP was thinking, maybe that it leans more into functional patterns & sugar for those whereas rust/go can also be used in a procedural style. (Though at least personally I am using way more functional patterns in rust than I expected)