What kinds of tasks are you giving to the LLMs? I don’t think I do anything that can rack up costs like that. I can only imagine you’re using lots of instances simultaneously. I’d love to know more and ideally see the deliverables if the code is public, or even just the product.
I recently talked with a guy that’s pretty smart and is building a good product with a clear market. I understood the idea and encouraged him to ship.
Then he showed me what he considers his real work, and went off on a madman’s raving presentation of some supposedly hyper scalable revolutionary encrypted block chain dApp agentic operating system. He was building all of this using lots of agents. And I could totally see him spending $500/day on tokens. But I also couldn’t get him to explain the use case. I couldn’t imagine one myself. I’m by default suspicious of large AI bills. People usually only have a short amount of roadmap that’s well thought out and proven. Building faster means you just hit a new bottleneck in product design.
But I want to learn more and accrue more case studies of AI use in software engineering. Sometimes I hear of some really great software engineering techniques only possible thanks to AI (stuff like running 3 models in parallel optimizing a hot loop, comparing outputs with a rigorous test suite and fuzzing).
I recently talked with a guy that’s pretty smart and is building a good product with a clear market. I understood the idea and encouraged him to ship.
Then he showed me what he considers his real work, and went off on a madman’s raving presentation of some supposedly hyper scalable revolutionary encrypted block chain dApp agentic operating system. He was building all of this using lots of agents. And I could totally see him spending $500/day on tokens. But I also couldn’t get him to explain the use case. I couldn’t imagine one myself. I’m by default suspicious of large AI bills. People usually only have a short amount of roadmap that’s well thought out and proven. Building faster means you just hit a new bottleneck in product design.
But I want to learn more and accrue more case studies of AI use in software engineering. Sometimes I hear of some really great software engineering techniques only possible thanks to AI (stuff like running 3 models in parallel optimizing a hot loop, comparing outputs with a rigorous test suite and fuzzing).