NotAnOtter

I think open source models could be vulnerable to these attacks. So long as I sandbox everything then I am as secure as my sandbox which is air gapped from my personal stuff i.e. no models on the same machine I log into my bank.

I know closed source models will have nefarious shit injected into it. It will start modest at first, of course, they need to get past the hyper scrutiny phase. Then it will simply be telemetry, then it will simply be feeding my behaviors into ad targeting, then it will simply be computer vampirism, and so on. One step at a time.

I prefer a gremlin I know I need to keep chained than a seductress I think I can probably trust.

But that's exactly my point?

Most algo's, especially ones made as a 'side project', are actually just directional bets and not true algorithms. And there are cheaper ways to take directional bets thus most of these are actually losing money - if the author just understood their directional bet, they could buy relevant stock/options to have the same risk profile for cheaper. But compiling algorithms back down into their directional components is an entire field in quant finance, akin to something like DS&A for CS.

Which is the joke I was referencing. When you take a directional bet and win, that isn't proof you're algorithm 'worked', it proves your directional bet won. Akin to someone who "vibe codes a website" and then sends you a localhost url. It's proof you're just making shit up and not aware of what it is you're building or how it works.

You think there won't be a job where you're primary duty is to write & maintain software in 10 years?

Trading algo generating revenue in a bull market is a meme among many trading communities.

As models get better and better at doing the stuff users are asking it do to, the more and more they trust it and grant it increased privileges.

Back when AI was new, I needed to check every single output because it was 50/50 on the code being complete junk. Now 99% it's correct first time and 1% close but needs some tweaking. I'm lazier and lazier WRT granting permissions and just trusting it to go nuts.

Mostly trying to think about what career to pivot to, since SWE wages are going to get crushed in the next 5-10 years.

If you owe the bank $10k, that's a you problem.

If you owe the bank $10Mil, that's the banks problem.

If you steal $10Bil from the bank, the government bails out the bank and now it's everyone's problem.

I think there has always been a spectrum between utility and art, with most things falling obviously into one camp or the other. Assuming all else being equal (climate impact, etc), the ability to provide a utility for cheaper is nearly always good.

99.99% of software is a utility. It being cheaper to produce is a net win for society. The LLM-solution isn't an "all else being equal" scenario, there are other obvious downsides. But the part where an in-demand utility got cheaper is very good.

FWIW - I think the small business market is actually very suitable for former SWE's. The capacity to troubleshoot processes, variance, bottlenecks, etc. is what turns a mom& pop shop into a regional chain.

I think you underestimate how many people would be willing to battle a computer if it meant doubling their salaries. Think of all the teachers with STEM degrees being paid $60k, if someone offered them $120k to prompt a computer for a while I'm sure many would come running.

And that's literally one single profession.

Disclaimer; I often feel dread around my career fading and needing to switch to a field I don't like & won't be paid well in.

That said, I think the rational perspective is "things will be fine, basically".

I tried writing a longer reply but organized thought drifted into ramblings about economics I only partially understand. TL;DR I think some opportunities will close and others will open, and current engineers will find a home. Mostly software architecture or as technical advisors for product companies (if everyone writes code, you need some Dude Who Knows It Well to guide the non-engineers when they get stuck. Akin to IT).

I think wages will stagnate but wages are generally inflated, if we're being honest. As much as I love my doctor-level salary, I can honestly say I don't deserve it.

Same thing happened to me!

I had a comment deleted by reddit admin & it banned my account, I appealed and received a message apologizing for the mistake and they unblocked my comment. But my entire account is still banned! Screw the comment I want my old account back. I've appealed many times but of course, no response. It's just being sent into the void.

Seems there is just no reason to use the website anymore. Either you post the most boring hive-mind nonsense, or otherwise just get banned.

Bad faith argument

Not gonna keep going back and forth when you seem to agree but are choosing to be difficult. We agree SO was falling before LLM's hit the market. We agree LLM's accelerated SO's demise.

You seem to think they weren't failing before LLM (simply rapidly losing member activity), which is a narrative that I won't follow.