ineptech
Joined 10 years ago
Joined 10 years ago
That hasn't changed, but what has changed is that reading docs and writing the glue code is effectively free. The main problem with something like Solid is, if it takes even an hour to figure out how to get it going, I am effectively assigning my friends an hour of homework to be able to network with me. That's no longer true. If you like the Fediverse and I like Solid and Dave uses Nostr and Sally is stuck with some proprietary thing that came with her NAS, we can all build a network without any of us switching to, or even learning much about, each other's platforms.
> Dave: "Bot, add a folder to my personal data store with the pictures I took this weekend and share it with everyone in my poker group"
> Sally: "I see that I've gotten an email from Dave with a magic link conveying access to something. Bot, use this link to negotiate a key exchange with whatever weird app Dave cobbled together (ask his bot if you need help) and then log into my VPS and add a tab to my personal webapp to display the content he has shared."
That might be overly optimistic, but it doesn't feel that far off. It's kind of what Tim Berners-Lee build https://en.wikipedia.org/wiki/Solid_project for right?
I'm wondering specifically about things like what kind of tool or restrictions you use on web browsing to avoid being flagged as a bot and how you guardrail access to your email (to avoid, say, the LLM deciding that "help me organize" includes telling people you want to reschedule). I use Qwen 3.8 26b at home and find it very useful for some tasks but when I think of using it as a general assistant rather than coding assistant, I keep thinking of times it has gone wildly wrong (e.g. it once spent 20 minutes trying to get around Supabase authentication because it couldn't figure why a certain call wasn't working)
a) the timer would be cumulative, so that solving the early words faster gives more time for the harder words,
b) going negative wouldn't end the game, it would just turn the time red or something, with the goal being to finish all of the words with the highest time-remaining possible, rather than just to win/lose.
I don't think it does that, it prohibits them from modifying it and then using that mod to fork users away from the original software, aka https://en.wikipedia.org/wiki/Embrace,_extend,_and_extinguis...
I went with this because a) the models I wanted to use are a little too big to fit comfortably in 24gb, plus I need room for a few additional small models for autocomplete and speech recognition, and b) I already had a cheap server to use and dual gpus would've required upgrading the mobo and power supply and probably the case as well.
It was definitely a little tricky to set up. The Intel line requires a driver package called "level zero" to support something called SYCL (Intel's version of CUDA basically, AFAICT) that was tricky to get working. I am running llama.cpp in a docker container, which also required some fiddling to get the container to see the card. You also need a kernel from the last few months.
Once I got it working though, the results are very impressive for a $1k investment. Qwen 3.6 35B at q4 quantization takes about 3/4 of the ram and delivers like 88 tokens/sec. So, if you want a decent-sized model for cheap, this is one way to go.
Like, suppose some really good personal server software existed. Suppose there were an OS-plus-app-repository platform, akin to linux plus snapcraft, but aimed solely at people who want to host a blog or email server despite knowing nothing and being willing to learn nothing. It installs on to a raspberry pi as easy as Windows. It figures out how to NAT out of your cable modem for you. It does all the disk partitioning and apt-gets and chmods, you just open the companion app on your phone and hit the Wordpress button and presto, you've got a blog. You hit the Minecraft button and you've got your own minecraft server, without having to learn what "-Xms2G -Xmx6G" means. It updates itself automatically, runs server components in sandboxes so they can't compromise each other, and it's crack-proof enough that you can store your bitcoins on it. Etc, etc.
If that existed, we wouldn't have to write essays about freedom and so forth to get people to buy it, they'd buy it just because it's there. I mean, look at those digital picture frames - they cost more than a rasbpi and are way less useful, and half the people I know got or gave them for christmas. Why? Because they're neat and they cost less than a hundred bucks and they require no knowledge or effort. If a server that can host your blog were that easy, it'd get adopted too, and we'd be on a path to some kind of distributed social media FB replacement. Imagine the software you could write, if you were allowed to assume that every user had a server to host it on!
The problem is, that software doesn't exist and it's not clear how it would ever get made. It'd be a huge effort (possibly "Google building Android" sized) and the extant open source efforts along these lines lack traction, mostly due to the chicken-and-egg problem of any new platform that needs apps to be useful. And until it exists, any kind of neighborhood-internet-collective-power-to-the-people dream has to necessarily begin with hoping that millions of people will spontaneously decide to spend their precious free time doing systems administration.
Not to shit on a fine essay that I mostly agree with. It just seems like, without figuring out the software, this is daydreaming.