_fat_santa
Joined 8 years ago
Joined 8 years ago
Knowledge workers use it primarily to "augment" their work, answer questions with AI, get it to create documents, etc. But it's usually 1 individual to 1-2 conversation threads.
Meanwhile in software development were running fleets of agents. At work we have it setup where firing off one agent request will eventually lead to like 10-20 AI calls at different parts of the process.
I make this distinctions because it changes how each group thinks about AI. For software devs it just feels like "moving up the stack". Yeah you're not writing code anymore but there is still plenty of work to do and problems to solve within your "software factory". Contrast that with knowledge workers that feel like the AI is making all of their decisions for them.
I almost think of this as a factory worker versus an artisan. The software devs are "factory workers" where we used to be on the floor but now we're managing the machines that took over the work. There are still tons of interesting problems at that stage and you still feel like you have worth. Contrast that with a knowledge worker that's more of an artisan in this analogy. For them they aren't running a factory but instead watching a robot do the work they used to do while they sit idle and watch it.
Yes it's not the same as hosting as your own hardware but I would argue that it accomplishes the same goals. The goal is to get other people out of your data. With a "service" the underlying company has every incentive to look at your data and use that to improve it's service, but when you host something yourself with a provider, it's in that providers best interest to never look at your data.
For me it all comes down to the goals of the people your are doing business with. With Cloudflare at least, their goal is to just upsell me on hosting equipment, they couldn't give a rats ass what I'm hosting on that hardware so long it's not illegal.
I'm working on a sideproject called Rowbly[1]. It acts as a sharable data store where LLM's can dump research rather than keeping it in their memory or throwing it into a spreadsheet.
At first I thought "I don't need an MCP, I'll just expose a CLI" but that carries a pretty big limitation in that it only works with agents on your computer (Codex, Claude Code, Pi, etc). For the folks on here this is not an issue and is often times preferable but I'm also targeting the average LLM user that primarily interfaces with it via "consumer AI" and with those tools the stuff you can do is very very limited.
I still think MCP's have a long way to go maturity wise and hey maybe in a few years we will figure out a better way to do things but for now, if you want to interact with consumer AI apps, there's just no way around using them.
[1]: https://rowbly.com
- The HF incident was to get the attention of investors and convey the message: "we have this incredibly powerful technology, imagine where we will be in 5 years"
- With this influencer campaign it's just a drive to get more people to use ChatGPT / sign up to ChatGPT so when IPO time comes, they can show strong user growth.
Over the past few months I've seen various reports that OpenAI's financial position isn't great and if those reports have any merit, then likely the higher ups at OpenAI are panicking that they might become a WeWork 2.0. Everything they are doing now is an attempt to justify their $1T valuation to investors during the IPO.
I don't think it's that hard of a question to answer. I've noticed on my team, our thinking has shifted from how do you directly solve a problem, to how you get an agent to effectively solve the problem and not produce slop in the process.
One thing that we have done that's probably made the biggest impact is alot more upfront architecture with the knowledge that pretty soon agents will be running wild all over the code. Having worked with these agents for a while now, you get a very good sense of how they will go about solving a problem and the various footguns they will encounter along the way. Editing an AGENTS.md file or building a skill is not nearly as fun as coding by hand but it will pay dividends over and over if you do it right.
Another big thing is doing refactoring passes. Early on in our projects our agents generated ALOT of slop and we had to go back and fix alot of it. But every time we did one of these passes, a major aspect was improving agent instructions / skills / etc so it doesn't happen again. It can be a painful process at first but I found that over time, the amount of slop the agent produces goes down by orders of magnitude.
I feel like we're still very much programming, but we're now doing it at a "higher level" where we are not writing the code ourselves but instructing the agent to. And IMHO, properly instructing an agent on a production codebase is not a trivial task.
It's like saying "Oh this car manufacturer claimed that their cars were the safest in the industry but couldn't prevent this driver from flying through the windshield" and omitting the fact the person wasn't wearing a seatbelt.
The better way IMHO is use local models so data never actually leaves the device.
Once in a blue moon it's actually the model making a material error in it's thinking and I have to go back and redo it.
Support had no answer for me other than "well you need the app". When I told them I didn't have a phone to install it on they just said "no that's not correct, you must have a phone..."
Often times it's not even that the code is bad but rather that it's overengineered. I see it happen so much that I'm tempted to actually go the other way on a toy project. Like what would Claude or Codex come up with if I told it I wanted an enterprise grade, globally scalable, compliant and auditable tic-tac-toe game.
The problem I've always had with trying out a tiling window manager like hyprland is you're going to spend a very long time trying to get everything just right. With Omarchy I get a really nice hyprland setup right out of the box.