evanreichard
Joined 12 years ago
Joined 12 years ago
I use an RTX 3090 (24GB) and a GTX 1080ti (11GB). Just the 3090 for 3.8 I get maybe 60tg/s (UD-Q4 quant), for both I get around 40tg/s (UD-Q6). Not apples to apples though considering it's different quants.
Here's my config: https://gitea.va.reichard.io/evan/nix/src/branch/master/modu...
It had the most bizarre solution; airplane mode, set time to one year in the future, reboot, wait a few minutes, set time to 6mo in the future, reboot, wait a few minutes, set time to now, reboot. Went from 200GB to like 15GB. Was ridiculous.
(For anyone looking at this and considering doing it, you also need to ensure iMessage retention is forever, otherwise the iPhone will think it's a year old and delete the messages)
Which I've been using with Qwen3 Coder. As long as infill is supported, that should work. I'll try later today.
It's what I did when I got a new opener. Works fine in HomeAssistant.
I picked up 32GB (2x16GB) DDR4 (CMK32GX4M2E3200C16) last September for $55. Now it's $155.
I've got two R640's so I can live migrate, and an R720XD with TrueNAS (democratic-csi for K8s persistence). QSFP (40Gb) for TrueNAS / R720XD, and SFP+ (10Gb) for R640's linked to a Brocade ICX 6610.
So I can update the hosts, and K8 nodes with 0 downtime. Do I need it? No, but I learned a lot and had / have fun deploying and maintaining it.
I'm still giving Orion a chance for now... I just installed a slightly older version that works.
[0] https://orionfeedback.org/d/10197-bitwarden-hangs-on-load
I did rename the ota binary. I'm aware that there's always the possibility of Amazon maybe having some other way to push an update, but I haven't had any issues so far.