roosgit

Got the same thing a few days ago when registering a .com domain. A .online was offered for free. I’ve, unfortunately, been trained to be wary of gifts, so I removed the "free" offer, especially because I knew it can’t be free forever. Plus had no interest in an .online domain.

Still I thought it was a pretty unclassy move.

Just the other day I was thinking why does the American Osteopathic College of Radiology website link to a listitcle about Halloween constumes on a website with 10 pageviews/week? Google Analytics was showing two visits even after I used several filters to weed out most of the uninteresting traffic. Checking the logs showed that it was clearly referrer spam.

A few days earlier, I got an alert that the same aocr.org was possibly hotlinking some image. Again, checking the logs on my image server showed that it was just some bot crawling images and using the aforementioned website as referrer.

I was wondering the same thing. Maybe it’s a licensing issue. Or the models are too big and there isn’t enough demand. But size is not a solid argument because they also don’t support Qwen3.6 27B and 35B-A3B, especially since they just added Gemma 31B and 26B-A4B.

Amazon, the first quadrillion-dollar company.

Yeah, it should have been "Datacenter GPUs" or "Nvidia and AMD GPUs".

I just hit that error a few minutes ago. I build my llama.cpp from source because I use CUDA on Linux. So I made the mistake of trying to run Gemma4 on an older version I had and I got the same error. It’s possible brew installs an older version which doens’t support Gemma4 yet.

Have you tried other local models?

The 14B Q4_K_M needs 9GB, but Q3_K_M is 7.3GB. But you also need some room for context. Still, maybe using `--override-tensor` in llama.cpp would get you a 50% improvement over "naively" offloading layers to the GPU. Or possibly GPT-OSS-20B. It's 12.1GB in MXFP4, but it’s a MOE model so only a part of it would need to be on the GPU. On my dedicated 12GB 3060 it runs at 85 t/s, with a smallish context. I've also read on Reddit some claims that Qwen3 4B 2507 might be better than 8B, because Qwen never released a "2507" update for 8B.

I wasn't sure where I'd seen that "retiring" spiel before, but then I remembered someone was (still is) selling a handmade jewelry website claiming $4.3M revenue and $1.3M profit.

I use an even older Macbook and an even older macOS. Of course, the browsers no longer work with the latest JS, so occasionally when I need to use some webapp I boot up a Linux VM and do what I need to do. With limited RAM even that's a pain, but it works for now.

Can confirm. I was trying to send the newsletter (with SES) and it didn't work. I was thinking my local boto3 was old, but I figured I should check HN just in case.