shireboy

I’m old enough to remember experts-exchange, a site so terrible and if you removed a dash…. But somehow everyone used it, until stack overflow made it 100x better. After a while in IT I’ve gotten numb to the hype cycles, and recognize just how temporary everything is. I can pretty much guarantee you that even big names today like OpenAi, Microsoft, Apple, will eventually go the way of IBM or worse.

The Ackbar Effect

When this first landed I asked what the fix could even be. Everyone needs a new ID at a minimum. But then I got to thinking: 1) is that the point? Conspiratorial thinking I know but “hey all Our ids got hacked I guess we need a national id”. And related 2) the current id system from a security standpoint was a band aid fix for outdated world to be shoehorned into a modern one. IDscan was never cryptographic proof you were who you said you were. Maybe better than “enter your name and SSN” but bottom line, at least in US there is no cryptographically secure identity system that proves you are the citizen you say. And that fact bleeds into all sorts of patchwork solutions, fraud, etc. Moreover there are serious philosophical hurdles to getting to one. I’m not even positive I want one. But unless there is some zero-trust way to do this, I’m not sure what the fix would be.

What even would be the fix for this? 153m people need new license asap and id verification systems need to block the stolen ones? Also what are some of the bad things this could cause: a risk malicious actors open verified accounts in their name, ability to vote and travel under stolen id, what else?

3d splatting takes on a different meaning in this context.

Yeah, I mean the last 3 or four big releases of models have come with big scary news. I have to think there is at least some intentional marketing effort behind all this

A maxim I’ve arrived at working w llm every day is “put deterministic things in code, non deterministic in llm”. I do wish the harnesses would be more helpful in this regard. For example I’ve seen tons of scheduled jobs that people wrote in Claude/copilot/etc that could easily have been scripts. They aren’t scripts because the author doesn’t know how to script and they stop at the point the llm does what they want. It isn’t hard to then tell the llm “make a script to do all of the tool calls this prompt needs and then pass the result back to the llm for this non-deterministic part”.

What is the “middlest” Mac one could get for this? I’m in the market but keep going back and forth between a 64gb m5 pro or “lower end m5 air and screw it I’ll just pay for cloud tokens”. At current prices the 2-3k diff to try to run something local that isn’t as powerful could buy a lot of tokens.

Yup. I’ve been evaluating several on openrouter and find token cost meaningless for my work. I haven’t found a great alternative, though the “cost per task” he uses makes some sense.

My thought process is that I don’t mind a slower model if it can work in background for me 24/7 fleshing out side gig ideas I have floating around but no time to focus on myself. I take your point though, and it’s why I haven’t bit the bullet yet. I could buy a lot of tokens for 5k. If I could make that effective then the roi of offline should be something I can calculate fairly easily.

I’ve been considering a move to local llm setup, having been underwhelmed coat vs value of various online offerings. But at the same time worried anything I get will be obsolete in a couple months. And I don’t want to have to babysit it. I really want some agents managing and creating side hustles for me and have some other things. I’m technical-have written my own harness and use gh copilot and grok daily and have a hosted openwebui+openrouter thing. I’m also torn between a 128g MacBook Pro or a framework, or spark or similar and lightweight laptop to access. Would love advice anyone has for (or against) going local. I have asked ai but have analysis paralysis as 5k would be a big investment for me so I want to make right choices

We’ve been using aikido code scanning and pen test tools and been pretty impressed. Will have to take a look at this.

I have thought that extremely accessible, portable, non-radiation imaging would be revolutionary. Imagine every doctor - or even every person - had a handheld thing they could wave over your affected area to get a high res 3d image of the issue. Of course we have mri, xray, and ultrasound, but those are big and expensive. Obviously there are engineering reasons that is the case, but It seems like a concerted effort to make imaging more portable and accessible, coupled with ai to help analyze could bring about all sorts of follow-on health improvements. Your regular practitioner could check you for heart blockages, clots that lead to stroke, cancers etc as a matter of course. I’m not sure stepping into a golden vat of water is what I have in mind but medical imaging does seem like a possible area for drastic innovation.

I tried this but it took over my mic and people couldnt hear me on teams call until I turned it off. Nice idea but needs to share the mic w teams to be useful for me. Not sure if it’s teams fault or trace fault but either way…

Maybe dumb question: One of the use cases is instrument reading of analog instruments. My brain immediately goes to "this should have some sensor sending data, and not be analog". Is having a robot dog read analog sensors really a better fit in some cases?