raffraffraff
Joined 10 years ago
Joined 10 years ago
M1 Max 400GB/s
M4 Pro 273GB/s
M5 Pro 307GB/s
Only Max are worthwhile for LLMs. An Ultra is just two Mac chips on a die, but I think they're just used in Mac Studio.I'll check it that inference engine! Thanks!
Edit: it doesn't give numbers for unsloth/Qwen-3.6-35B-A3B 4bit, but I'm using mlx-serve right now and getting petty good numbers (and it took a while to tweak everything properly!)
MiniPC network device doesn't have a Linux driver. At all. Had to get a vibe-coded, reverse engineered one. This was a first for me.
NAS (ugreen) was a pain in the ass to install my own OS on (I didn't trust theirs, wanted OpenSUSE, and had to get a reverse engineered LED controller driver so I could display hard drive health)
ASUS Laptop will not sleep properly, and would drain the battery flat in a day or do. Myself & Claude gave up after days of trying various tricks workarounds (up to BIOS hacks). The best I can do is hibernate (after about 5 minutes of sleep) but man, the hacky bullshit required to get there was incredible.
Different laptop sleeps fine but will not, under any circumstances, hibernate. Even though I have all the crazy tricks up my sleeve from the ASUS that won't sleep properly and needs to hibernate. Different hardware, totally different bullshit problems.
And then I recently got an Macbook M1 Max for local LLM hacking and everything just fucking works. I don't like MacOS but the hardware is amazing and the OS just fucking works with it (and I like that).
Like you say, a lot of countries get a pass because a neighbour invested billions and decades building nuclear. Or else they fall back to coal/gas.
The fact is, she would feed any of them, but only crow taps on the window, and goes from one window to the next as my mother moves through the kitchen. The others only get the leftovers, but they line up on the fence.
What's your experience with Matter / Thread? Is it a case of buying a different USB dongle and devices?
I've had success launching the browser and using dumb dumb methods to get around the captcha before attaching playwright.
Dumb dumb methods = wmctrl, xdotool, bash (work fine for Cloudflare's "are you human" check)
I was going to add Spotify metadata from that recent data dump, but it's kinda trash data (valence isn't trustworthy, wildly wrong a lot of the time).
I then stumbled on lrclib data dump, local LLM and a super two step prompt that extracts extremely high quality lyric based metadata (about the narrator, protagonist, setting, story arc, moods etc)
Anyway, even though I bitched about MusicBrainz in another comment, their JSON dumps can be coaxed into giving the sort of metadata that I wanted to get from RYM, who absolutely suck due to their crazy aggressive blocking, self sabotage and unforgivable data poisoning if you trigger their bot tripwire. Their data came from their users, but as a paying user you can't use their site to tag your music. No API, and you get banned if you try to write a music player plugin to fix the tags in your "now playing" track. I don't know what their business plan is, or who they think their audience is.
As for social features, nobody is ever going to use MusicBrainz. They might have used RYM or Last.FM before the site owners made them unusable or pointless.